Skip to content

IN PERSON Apache Kafka® Meetup Chennai - February 2024

Photo of Dinesh Kumar P
Hosted By
Dinesh Kumar P. and 2 others
IN PERSON Apache Kafka® Meetup Chennai - February 2024

Details

Hello everyone! Join us for an IN PERSON Apache Flink & Apache Kafka® meetup on February 22nd from 11 am, hosted by Facilio in Chennai!

📍 Venue:
Facilio, A-19 & 20, Guindy Industrial Estate, 10th floor, SIDCO Industrial Estate, Guindy, Chennai, Tamil Nadu 600032

https://maps.app.goo.gl/nfUizS7irAA2aDEm9

***
Agenda:

  • 09:15 - 9:30: Registration
  • 09:30 - 9:45: Welcome and Introduction
  • 09:45 - 10:45: Lakshmi Narasimhan, Director, Quadrant Labs
  • 10:45 - 11:00: Break
  • 11:00 - 12:00: Barath G, Data Engineer, Photon
  • 12:00 - 1:00: Jegan Nagarajan, Senior Customer Success Architect, Confluent
  • Lunch

***
💡 Speaker:
Lakshmi Narasimhan, Director, Quadrant Labs

Talk:
Real-Time IoT Data Processing with Kafka & Flink

Abstract:
Ever wondered how smart cities process massive amounts of sensor data in real time? From traffic congestion to air quality monitoring, IoT devices generate continuous streams of data that need to be processed efficiently. Traditional databases and batch processing systems struggle to keep up, but that's where Kafka and Flink shine.
In this beginner-friendly talk, we'll break down the why and how of real-time stream processing with Kafka and Flink. You'll learn:
✅ Why Kafka is ideal for collecting and streaming high-frequency IoT data.
✅ How Flink enables real-time analytics, anomaly detection, and windowed aggregations.
✅ Why this approach outperforms traditional polling and batch-based methods.
Best of all, we won’t just talk about it—we’ll show it in action! We'll walk through a live demo using Docker Compose, simulating IoT sensors, processing their data with Flink, and visualizing the results. Whether you're new to stream processing or just curious about Kafka and Flink, this session will give you the confidence to build real-time data pipelines in your own projects.
No prior experience required—just bring your curiosity!

-----
💡 Speaker :
Barath G, Data Engineer, Photon

Talk:
Real-Time Streaming into Apache Iceberg: Challenges, Benefits, and Best Practices

Abstract:
Apache Iceberg has emerged as a powerful table format for managing large-scale data lakes, offering strong schema evolution, time travel, and ACID compliance. However, integrating real-time streaming data into Iceberg using Apache Kafka, Apache Spark, and Apache Flink presents unique challenges, including metadata management, compaction strategies, and query performance optimization. This session explores the complexities of streaming data ingestion into Iceberg, covering schema evolution, partitioning strategies, and best practices for handling high-throughput data. We will also discuss the benefits of using Iceberg for real-time analytics, including improved query performance and cost efficiency, while addressing common pitfalls in streaming pipelines.

-----
💡 Speaker :
Jegan Nagarajan, Senior Customer Success Architect, Confluent

Talk:
Shift Left: End Data Chaos at the Source and Unlock Real-Time Insights

Abstract:
By adopting a shift-left approach, you position data extraction, transformation, and governance as close as possible to its source, where the data is generated and remains freshest. This approach dramatically eliminates redundant pipelines and manual break-fix tasks, significantly reducing both complexity and costs associated with traditional data environments. Because data is processed early and consistently, teams can rely on high-quality, well-modeled data products that serve both operational and analytical needs. The result is faster access to real-time insights, better decision-making capabilities, and an overall reduction in data chaos—paving the way for an efficient, unified data strategy across the entire organization.

***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
As the classroom is a mask-on setting, please be reminded that masks should still be worn at all times unless actively eating or drinking
NOTE: We are unable to cater for any attendees under the age of 18.

***
If you would like to speak or host our next event please let us know! community@confluent.io

Photo of Chennai Apache Kafka® Meetup by Confluent group
Chennai Apache Kafka® Meetup by Confluent
See more events
Facilio
A-19 & 20, Guindy Industrial Estate, 10th floor, SIDCO Industrial Estate, Guindy, Chennai, Tamil Nadu 600032 · Chennai