Elastic | Apache | Kafka® Meetup Pune

Join us for an IN PERSON Apache Kafka® meetup on February 15th from 11:00 am, hosted by One2N!

📍 Venue:
One2N
2nd Floor, Rachna Ventura, ITI Rd, Ward No. 8, Pushpak Park, Aundh, Pune, Maharashtra 411007, India
***
Agenda:

• 11:00am - 11:15am: Registration & Welcome
• 11:15am - 11:55am: Ashish Tiwari, Sr. Developer Advocate (Elastic)
• 11:55am - 12:35pm: Kalpesh S. Deo, Lead Software Engineer at One2N
• 12:35pm - 13:15pm: Chinmay Naik, Founder, One2N
• 13:15pm - 14:00pm: Lunch

***

💡 Speaker: Ashish Tiwari, Sr. Developer Advocate (Elastic)
Talk: Monitoring Kafka using Elastic Observability
Abstract: In this talk we will see how to keep an eye on your Kafka setup with Elastic Observability. It helps you track things like message flow, consumer lag, and broker health in real time. Spot issues quickly and ensure your Kafka runs smoothly.
Bio: Ashish, a former software engineer and startup co-founder, is now a Senior Developer Advocate at Elastic. Passionate about tech, he empowers the community with Elastic Stack solutions and explores Generative AI
-----
💡 Speaker: Kalpesh S. Deo, Lead Software Engineer at One2N
Talk: Building an ELT Pipeline: Streaming Data from Postgres to Elasticsearch with Airbyte and Kafka
Abstract: In this talk, we’ll explore how to build an efficient ELT pipeline to synchronize data from PostgreSQL to Elasticsearch using Airbyte and Kafka. The pipeline transforms and consolidates data from multiple PostgreSQL tables into a single Elasticsearch document, enabling fast and scalable search capabilities. We’ll discuss the challenges encountered, the strategies used for real-time synchronization, and how Kafka’s message streaming and Airbyte’s connectors simplify the process.
What you will learn:

• ELT vs. ETL: Understand why ELT pipelines are gaining traction for modern data integration and how they reduce operational overhead.
• Toolchain Integration: Step-by-step guidance on configuring Airbyte connectors for PostgreSQL and Elasticsearch, with Kafka as a fault-tolerant event streaming layer.
• Denormalization Techniques: How to merge data from multiple relational tables into a single, optimized Elasticsearch document for faster search and analytics.
• Real-Time Syncing: Implement Kafka to handle incremental data changes and ensure near-real-time updates in Elasticsearch.

Bio: Kalpesh is a tech lead with 16+ years of experience who excels at getting things done. He has extensive expertise in designing and developing API-based backend systems in cloud environments, as well as crafting fast and responsive Mobile and Web UIs. As a Lead Software Engineer at One2N, Kalpesh drives backend engineering in Golang and Java, helping companies successfully launch products.

-----
💡 Speaker: Chinmay Naik, Founder, One2N
Talk: Just enough queuing theory to be dangerous
Abstract: Queues are everywhere around us - both in real life and in software systems. In this talk, you'll learn just enough queuing theory to make you better at building asynchronous and event-driven systems. You’ll understand how to monitor and scale asynchronous systems and how to do capacity planning. Although the title of the talk has the word “theory” in it, you'll understand the practical view and learn to use the principles of queueing theory in practice to solve a real-world use case at the scale of millions of requests per day.
We will also cover two production use cases where we used Kafka as a message bus and Elasticsearch as a search index, and how we leveraged both to handle scalability.
Bio: Chinmay is a pragmatic engineer who believes good software engineering is about managing trade-offs well. He founded [One2N] ([https://one2n.io/](https://one2n.io/)) to help startups solve their backend and reliability engineering problems during the growth phase. Talk to him any day about backend and reliability engineering, psychology, and playing percussion, he won't disappoint you.

***
DISCLAIMER: BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
As the classroom is a mask-on setting, please be reminded that masks should still be worn at all times unless actively eating or drinking
NOTE: We are unable to cater for any attendees under the age of 18.