India Open Source Data Infrastructure Meetup - October 2023

• Are you interested in learning more about open-source data technologies? ✅
• Do you want to network with local and international tech professionals in a fun, relaxed environment? ✅

Then join us on October 22, at the CRED offices, for an evening full of inspiring conversations and exciting talks.

Agenda:

• 11:00 - 11:30 Welcome: Networking & refreshments
• 12:30 - 11:40 Kickoff: Welcome from Aiven and CRED
• 11:40 - 12:00 Delta lake tables - behind the scenes - Apoorva Aggarwal
• Speaker: Apoorva works at Microsoft as a Software Engineer 2. She's been active in the data infrastructure domain for close to 5 years now.
• Abstract: In this talk, we will explore the storage format of delta lake tables, its transaction log management, and the optimizations it uses to process and retrieve big data faster
• 12:00 - 12:20 Data Quality Platform at CRED - Chintan Shah, Manas Bhardwaj, Abinasha Karana
• Speakers: Manas Bhardwaj from CRED is part of the data engineering team. Passionate about building open source data platforms, prior to CRED he has worked with Cleartrip. He has extensive experience with open source projects like Apache Airflow, Kafka, Storm, Spark, Great Expectations and working on new features to projects like Great Expectations. Outside work he can be found planning his next trip or the next culinary adventure.
  Chintan Shah is Data Product Manager at CRED. He comes with ~15 years of experience across Financial Services, SaaS Products and FinTech. His primary focus area is improving resilience, scalability and performance of Big Data Platform as well as making high - quality data available for key use cases across businesses. In addition to Data, Chintan loves to talk about Financial products, investing and customer experience.
  Abinasha Karana works as technology leader at CRED. His passion is “Real time nature of Big Data Computation”. He has been a speaker at "Apache Hadoop India Summit " , "The fifth elephant", “Microsofft TechEd - Hadoop on Azure Track”, “Cloudera Bigdata BigQuestions Event” and “Hadoop Track at IIT Mumbai , Computer Science BTech Curriculum”. Abinasha has 25 years of industry experience.
• Abstract: Chintan, Abinasha and Manas share Cred's journey of building a trustworthy big data quality platform in AWS. In this talk, they will cover the requirements of the platform, the challenges encountered, the technologies chosen, and the tradeoffs that were made to build a high quality large-scale diverse data lake.
• 12:20 - 12:40 Evolving data infrastructure for scaling a data platform - Rohil Surana
• Speaker: Rohil is an Engineering Manager at Cloud@Pixxel, with prior experience in spearheading infrastructure for Data Platform at Gojek. Six years of experience in the realms of Data and Infrastructure.
• Abstract: The talk goes into how we managed and evolved the underlying infrastructure using IaC and developed a configuration and orchestration system which powered a Data Platform at scale.
• 12:40 ~ 14:00 Food & networking

By attending this event, you agree to abide by our community code of conduct.