IN PERSON Apache Kafka® Meetup Chennai - February 2024


Details
Hello everyone! Join us for an IN PERSON Apache Flink & Apache Kafka® meetup on February 22nd from 11 am, hosted by Facilio in Chennai!
📍 Venue:
Facilio, A-19 & 20, Guindy Industrial Estate, 10th floor, SIDCO Industrial Estate, Guindy, Chennai, Tamil Nadu 600032
https://maps.app.goo.gl/nfUizS7irAA2aDEm9
***
Agenda:
- 09:15 - 9:30: Registration
- 09:30 - 9:45: Welcome and Introduction
- 09:45 - 10:45: Lakshmi Narasimhan, Director, Quadrant Labs
- 10:45 - 11:00: Break
- 11:00 - 12:00: Barath G, Data Engineer, Photon
- 12:00 - 1:00: Jegan Nagarajan, Senior Customer Success Architect, Confluent
- Lunch
***
💡 Speaker:
Lakshmi Narasimhan, Director, Quadrant Labs
Talk:
Real-Time IoT Data Processing with Kafka & Flink
Abstract:
Ever wondered how smart cities process massive amounts of sensor data in real time? From traffic congestion to air quality monitoring, IoT devices generate continuous streams of data that need to be processed efficiently. Traditional databases and batch processing systems struggle to keep up, but that's where Kafka and Flink shine.
In this beginner-friendly talk, we'll break down the why and how of real-time stream processing with Kafka and Flink. You'll learn:
✅ Why Kafka is ideal for collecting and streaming high-frequency IoT data.
✅ How Flink enables real-time analytics, anomaly detection, and windowed aggregations.
✅ Why this approach outperforms traditional polling and batch-based methods.
Best of all, we won’t just talk about it—we’ll show it in action! We'll walk through a live demo using Docker Compose, simulating IoT sensors, processing their data with Flink, and visualizing the results. Whether you're new to stream processing or just curious about Kafka and Flink, this session will give you the confidence to build real-time data pipelines in your own projects.
No prior experience required—just bring your curiosity!
-----
💡 Speaker :
Barath G, Data Engineer, Photon
Talk:
Real-Time Streaming into Apache Iceberg: Challenges, Benefits, and Best Practices
Abstract:
Apache Iceberg has emerged as a powerful table format for managing large-scale data lakes, offering strong schema evolution, time travel, and ACID compliance. However, integrating real-time streaming data into Iceberg using Apache Kafka, Apache Spark, and Apache Flink presents unique challenges, including metadata management, compaction strategies, and query performance optimization. This session explores the complexities of streaming data ingestion into Iceberg, covering schema evolution, partitioning strategies, and best practices for handling high-throughput data. We will also discuss the benefits of using Iceberg for real-time analytics, including improved query performance and cost efficiency, while addressing common pitfalls in streaming pipelines.
-----
💡 Speaker :
Jegan Nagarajan, Senior Customer Success Architect, Confluent
Talk:
Shift Left: End Data Chaos at the Source and Unlock Real-Time Insights
Abstract:
By adopting a shift-left approach, you position data extraction, transformation, and governance as close as possible to its source, where the data is generated and remains freshest. This approach dramatically eliminates redundant pipelines and manual break-fix tasks, significantly reducing both complexity and costs associated with traditional data environments. Because data is processed early and consistently, teams can rely on high-quality, well-modeled data products that serve both operational and analytical needs. The result is faster access to real-time insights, better decision-making capabilities, and an overall reduction in data chaos—paving the way for an efficient, unified data strategy across the entire organization.
***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
As the classroom is a mask-on setting, please be reminded that masks should still be worn at all times unless actively eating or drinking
NOTE: We are unable to cater for any attendees under the age of 18.
***
If you would like to speak or host our next event please let us know! community@confluent.io

IN PERSON Apache Kafka® Meetup Chennai - February 2024