Skip to content

Crossing the streams! - Foreign-Key Joins with Kafka Streams

Photo of Hays Prevost
Hosted By
Hays P.
Crossing the streams! - Foreign-Key Joins with Kafka Streams

Details

We all remember how cool it was when they crossed the streams, so we are going to do it live at the next meetup!

Let's wrap up the year by opening the hood on stream joins with Kstreams! This time we will have John Roesler, who is a Kafka committer working at Confluent, and Ghassan Yammine who has been implementing joins at Bazaarvoice

Have you ever wished that KTable joins worked like SQL joins? Well, now they do! Foreign-key, many:one, joins were added to Kafka in KIP-213, to be released in Kafka 2.4. In this meeting, we'll do a deep dive into the surprisingly complex implementation required to compute these joins correctly. Building on that understanding, we'll discuss how you can expect Streams to behave when you use the feature, including how to test it, and thoughts on optimization. Bazaarvoice has been using this feature pre-release, and Ghassan Yammine from Bazaarvoice will discuss their use case and implementation, as well as their operational experience so far.

Schedule:
6-7PM - Happy hour w/ drinks and dinner sponsored by Vrbo
7-8PM - Speaker presentations
8-9PM - Q&A - break out discussions.

Photo of Austin Apache Kafka Meetup - Stream Data Platform group
Austin Apache Kafka Meetup - Stream Data Platform
See more events