What we’re about
This group is for people interested in Apache Kafka and stream processing. If you are interested in presenting at a future event, please fill out following form https://forms.gle/KmtmZZYn1TVJMNAk9
Upcoming events (1)
See all- IN PERSON! Apache Kafka® Meetup Bangalore- May 2024Razorpay - Payment Gateway & Payment Solutions for India, Bengaluru, KA
Hello everyone! Join us for an IN PERSON Apache Kafka® meetup on May 11th from 10:30AM, hosted by Razorpay in Bangalore!
📍 Venue:
Razorpay Software Private Limited
8th Floor, SJR Cyber, 22 Laskar Hosur Road, Adugodi, Bengaluru, 560030
https://goo.gl/maps/N3Wc5XVWVyn1LhkW9
***
Agenda:- 10:30 - 10:40: Welcome and Introduction
- 10:40 - 11:20: Jeevan D C, Principal Engineer, Nimverge
- 11:20 - 12:00: Rishabh Singh, Software Engineer, Imply
- 12:00 - 12:40: Sivasubramaniam Sivakumar, Senior Solution Architect, Confluent
- 12:40 - 13:40: Lunch
***
💡 Speaker:
Jeevan D C, Principal Engineer, NimvergeTalk:
Effective Data Consumption from Kafka: Configuring Consumers for Reliability and Speed and their tradeoffsAbstract:
We'll dive into various configuration parameters that can be adjusted to fine-tune the behavior of Kafka consumers, such as fetch size, max poll records, session timeout, and heartbeat interval. You'll learn how to select appropriate values for these parameters based on factors like data volume, message size, and system resources.Additionally, we'll cover strategies for managing consumer groups, partition assignment, and rebalancing to ensure load balancing and fault tolerance. Gain insights into best practices for configuring consumer groups, handling consumer failures, and minimizing disruptions during rebalancing events.
If time permits, the talk will also address topics like consumer lag monitoring, consumer offsets management, and consumer restart handling, which are essential for maintaining data consistency and ensuring reliable message delivery in production environments.
Furthermore, we'll explore the impact of batch processing and record batching on consumer performance, and discuss how to choose appropriate batch sizes and configurations based on the trade-offs between throughput, latency, and resource utilization.
-----
💡 Speaker:
Sivasubramaniam Sivakumar, Senior Solution Architect, ConfluentTalk:
Don't leave your Kakfa cluster unsecured! - A Beginner's guide to Kafka Authentication and Authorization.Abstract:
TBC-----
💡 Speaker:
Rishabh Singh, Software Engineer, ImplyTalk:
Apache Kafka x Apache DruidAbstract:
TBC
