IN PERSON! Apache Kafka® Meetup Bangalore- May 2024

Hello everyone! Join us for an IN PERSON Apache Kafka® meetup on May 11th from 10:30AM, hosted by Razorpay in Bangalore!

📍 Venue:
Razorpay Software Private Limited
8th Floor, SJR Cyber, 22 Laskar Hosur Road, Adugodi, Bengaluru, 560030
https://goo.gl/maps/N3Wc5XVWVyn1LhkW9
***
Agenda:

• 10:30 - 11:00: Registration/ Welcome and Introduction
• 11:00 - 11:40: Jeevan D C, Principal Engineer, Nimverge
• 11:40 - 12:20: Rishabh Singh, Software Engineer, Imply
• 12:20 - 13:00: Sivasubramaniam Sivakumar, Senior Solution Architect, Confluent
• 13:00 - 14:00: Lunch

***
💡 Speaker:
Jeevan D C, Principal Engineer, Nimverge

Talk:
Effective Data Consumption from Kafka: Configuring Consumers for Reliability and Speed and their tradeoffs

Abstract:
We'll dive into various configuration parameters that can be adjusted to fine-tune the behavior of Kafka consumers, such as fetch size, max poll records, session timeout, and heartbeat interval. You'll learn how to select appropriate values for these parameters based on factors like data volume, message size, and system resources.

Additionally, we'll cover strategies for managing consumer groups, partition assignment, and rebalancing to ensure load balancing and fault tolerance. Gain insights into best practices for configuring consumer groups, handling consumer failures, and minimizing disruptions during rebalancing events.

If time permits, the talk will also address topics like consumer lag monitoring, consumer offsets management, and consumer restart handling, which are essential for maintaining data consistency and ensuring reliable message delivery in production environments.

Furthermore, we'll explore the impact of batch processing and record batching on consumer performance, and discuss how to choose appropriate batch sizes and configurations based on the trade-offs between throughput, latency, and resource utilization.

-----
💡 Speaker:
Rishabh Singh, Software Engineer, Imply

Talk:
Realtime analytics with Apache Kafka and Apache Druid

Abstract:
TBC

-----
💡 Speaker:
Sivasubramaniam Sivakumar, Senior Solution Architect, Confluent

Talk:
Don't leave your Kakfa cluster unsecured! - A Beginner's guide to Kafka Authentication and Authorization.

Abstract:
This talk will help understand features available to secure your Kafka cluster on three main aspects of security - Authentication, Authorization and Encryption. We will delve into different authentication mechanisms and clarify some common misconceptions - What's the difference between PLAINTEXT and SASL_PLAINTEXT? SASL_PLAINTEXT vs SASL mechanism PLAIN? Should you use SSL or SASL_SSL? What SASL mechanism should you choose for your deployment?
Having authenticated correctly, how do you then secure your topics? How do we ensure clients have only the right access on the right topics? We will delve into ACLs (Access Control Lists) to provide the correct permissions. Finally, we will end with securing data at rest using the different encryption options available.