Kafka Streams: Perfectly balanced, as all things should be

Hello Kafkateers!

In order to do our part to help flatten the curve of the spread of COVID-19, we are moving all of our meetups online for the time being. Please find the details to join this meetup below.

-----

*Time below in CDT - to find out when the event is in your timezone follow this link: http://www.worldtimebuddy.com/event?lid=306&h=306&sts=26490540&sln=17-18&a=show

Agenda:
5:00pm-5:10pm: Online Networking (feel free to BYOB!!)
5:10pm-6:00pm: John Roesler, Confluent (Includes Q&A)

6:00pm: Log in or Join our Slack Space* (https://launchpass.com/confluentcommunity) and go to #events to ask any follow up questions!

Joining our slack space is not instant, so ensure that you follow the steps within this link before the day of the event if you can! https://launchpass.com/confluentcommunity

Speaker: John Roesler, Confluent

Bio:
John is a software engineer at Confluent, focusing mainly on Kafka Streams. Prior to that, he spent 6 years building and operating the high-volume streaming data platform at Bazaarvoice. Before getting into software, he has also been a tech writer and (briefly) an English teacher.

Talk: Perfectly balanced, as all things should be

Abstract: Kafka Streams cluster management is getting a huge overhaul.
We are tackling many of the hardest problems in distributed systems to solve the biggest pain points in managing Streams application clusters. There are numerous improvements recently completed or in progress right now:

• Fast ownership transfer of tasks (KIP-429)
• Balanced assignment of tasks (KIP-441)
• Background state migration (KIP-441)
• High-availability Interactive Query (KIP-535)
• Graceful recovery from exceptions (KIP-572)

This talk is a deep dive into our solution to distributing and managing stateful workloads in Kafka Streams application clusters. We'll talk about the assignment algorithm itself, as well as how Streams is able to keep the cluster up for processing and serving queries while state gets migrated around the cluster in the background.
We'll go over the configurations and log messages as well as the behavior you'll observe when operating your cluster. Finally, we will talk about future opportunities for Streams cluster management and open the floor for discussion.

---

Online Meetup Etiquette:
•Please unmute yourself when you have a question.
•Please hold your questions until the end of the presentation or use the zoomchat!
•Please arrive on time as zoom meetings can become locked for many reasons (though if you get locked out a recording will be available, but you may have to wait a little while for it!

----

If you would like to speak or host our next event please let us know! community@confluent.io