Skip to content

Exactly Once Support in Source Connectors

Photo of Alice Richardson
Hosted By
Alice R.
Exactly Once Support in Source Connectors

Details

Find out about other upcoming online meetups and recordings from past Apache Kafka® Meetups all over the world: cnfl.io/meetup-hub

-----
🗓 Agenda:

  • 18:00pm-18:05pm: Introduction & Online Networking
  • 18:05pm-18:50pm: Sambhav Jain, Senior Software Engineer, Confluent & Zakir Hussain Shaik, Senior Software Engineer II, Confluent
  • 18:50pm: Q&A

Have follow-up questions afterward? Log in to Slack or Join our Forum (https://www.confluent.io/community/ask-the-community) to ask any follow-up questions!

-----
💡 Speaker:

  • Sambhav Jain, Senior Software Engineer, Confluent
  • Zakir Hussain Shaik, Senior Software Engineer II, Confluent

Bio:
Zakir Hussain and Sambhav Jain are currently SSE-2 and SSE-1 in confluent respectively. They have extensively contributed to Kafka connect offering of Confluent in both on-prem and cloud solutions. Their work has ranged from developing new connectors to creating usability features around the connectors in cloud. More recently, they are working on designing and developing tools to decrease operational and support costs for connect in cloud.

Title:
Exactly once support in source connectors

Abstract:
Kafka added exactly once delivery (KIP-98) by introducing idempotent and transactional producers. This topic will cover how connect framework used these producers to introduce exactly once support in source connectors. We will discuss how transactions are handled by the producers, how connect ensures that source offsets are passed into the transaction identifiers and some use cases where EOD is very much required.

---
Online Meetup Etiquette:
• Please hold your questions until the end of the presentation or use the zoom chat during!
• Please arrive on time as zoom meetings can become locked for many reasons (though if you get locked out a recording will be available, but you may have to wait a little while for it!)
Important note: If Zoom asks for a password to join please use 'kafka'

----
If you would like to speak or host our next event please let us know! community@confluent.io

Photo of Indore Apache Kafka® Meetup by Confluent group
Indore Apache Kafka® Meetup by Confluent
See more events