IN PERSON! Apache Flink® x Apache Kafka® Meetup Bangalore- November 2023

Hello everyone! Join us for an IN PERSON Apache Kafka® meetup on November 4th from 10:30AM, hosted by Razorpay in Bangalore!

📍 Venue:
Razorpay Software Private Limited
8th Floor, SJR Cyber, 22 Laskar Hosur Road, Adugodi, Bengaluru, 560030
https://goo.gl/maps/N3Wc5XVWVyn1LhkW9

***
Agenda:

• 10:30 - 10:40: Welcome and Introduction
• 10:40 - 11:20 - Thyaga Raja, Sr. DevOps Engineer, Razorpay, and Mudassir Razvi, Senior Engineering Manager, Razorpay
• 11:20 - 12:00 - Irtebat Shaukat, Consulting Engineer, Confluent
• 12:00 - 13:00 -Lunch

***
💡 Speaker:
Thyaga Raja, Sr. DevOps Engineer, Razorpay, and Mudassir Razvi, Senior Engineering Manager, Razorpay

Talk:
Kafka Scaling

Abstract:
In this session we will cover two topics:
- Kafka Horizontal scaling with Kafka Rebalance
- Kafka Storage downsizing

-----
💡 Speaker:
Irtebat Shaukat, Consulting Engineer, Confluent

Talk:
End to End Exactly Once with Flink and Kafka

Abstract:
In this session we will be going over:
- Introduction

• Brief overview of stream processing.

- The importance of data correctness and the challenges of ensuring it.
- Understanding Delivery Semantics

• At-most-once, at-least-once, and exactly-once: What do they mean?
• Why is exactly-once processing hard in distributed systems?

- Apache Kafka’s Role

• Brief overview of Kafka’s durability guarantees
• Idempotent producer and Transactions in Kafka

- Apache Flink’s Guarantees :

• Flink’s checkpointing mechanism and distributed snapshots
• TwoPhaseCommitSinkFunction

- Putting It All Together: End-to-end Exactly-Once with Flink & Kafka ( Under the hood )
- Q&A Session

Bio:
I am a data-stack engineer, developing solutions with a focus on data transformation — with hands-on experience in designing & deploying fault-tolerant, scalable data streaming applications, both on-prem and cloud. I help customers in accelerating their journey of extracting insights from data

-----
💡 Speaker:
TBC

Talk:
TBC

Abstract:
TBC