Ravi Lalwani: What is the data lake journey of Dvara KGFS and what were the key milestones?
Bragadeesh Sundararajan: A data lake journey is a process of storing, transforming, and analyzing large amounts of data in a central repository known as a data lake. Our journey involved the following steps:
Data Ingestion: This is the process of collecting and storing data from various transactional databases. Data is ingested in real-time or batch mode, depending on the requirements of the organization.
Data Storage: Once the data has been ingested, it needs to be stored in a central repository. A data lake is a type of repository that can store structured and unstructured data in its raw form, allowing it to be accessed and analyzed later. We are using MySQL as the central data repository for all data ingestions.
Data Transformation: After the data has been stored in the data lake, it typically needs to be transformed and cleaned before it can be analyzed. This may involve processes such as filtering, aggregating, and joining data from different sources. Python scripts are used to transform the data and store it in cleaned data.
Data Analysis: Once the data has been transformed, it can be analyzed using a variety of tools and techniques, such as SQL queries, machine learning algorithms, or visualization tools. The results of this analysis can be used to gain insights, make decisions, and drive business value. Python scripts are used for ML, AI, and data analytics.
This story is from the January 2023 edition of Banking Frontiers.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the January 2023 edition of Banking Frontiers.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber? Sign In
Kamdhenu & Sammrudhi loans top rural customers
Unnayan Bharat Finance Corporation (UBFC) Director & Co-Founder Avneesh Trivedi shares the company's attempts to enhance the rural lending environment & deliver better services to its consumers:
It's going to be a 'world' of CBDCs
Practically, every central bank in the world is testing and readying a CBDC system:
Training for behavioral & social skills is key
3 CHROs from the top BFSI companies in India open up about their training and motivation programs aimed at enhancing employee effectiveness. The story is divided into 4 parts: (i) functional and behavioral training, (ii) manager to leadership training, (iii) learning-based training, (iv) motivational programs:
THE AI COMPASS
Artificial Intelligence has risen to be the hottest topic of discussion today. It is expected to impact everyone, and the impact could exceed that of war, global warming, supply chain disruptions, geopolitics, and much more.
To mentor & coach emerging leaders
Manish Shah, MD & CEO of Godrej Capital, outlines his focus areas today and in the future:
Innovation will unlock India's Mission 'Atmanirbhar’
Sunita Handa is Chairman, Toyota FSIN and Principal Advisor & TLAB Chairman, Protectt.ai Labs. She shares her current activities and her deep insights on innovaiton in an interaction with Manoj Agrawal:
Algorithm is the Boss
Irem Sayeed, Chief Credit Officer at U GRO Capital, dwells into business focus and modernization at the lender:
Fintech and Neobank under the same Umbrella
It was started in 1902 to build what came to be called Israel:
Bajaj Allianz Revolutionizes Employee's HR and IT Experience with WhatsApp, MS Teams, Al and Automation
A productivity booster shot at BALIC:
Small Beginning for a Big Opportunity
AMU Leasing's focus on serving the underserved market of individuals and fleets looking for financing for electric 3-wheelers and 2-wheelers: