IN PERSON! Apache Kafka® Meetup Berlin - January 2024
Details
Join us for an Apache Kafka® meetup on Tuesday, January 30th from 5:00pm in Berlin hosted by our friends at Amazon!
📍Venue:
Rocket Tower, Charlottenstraße 4 10969 Berlin. Floor 1.
**IMPORTANT: Please fill out this form 48 hours prior to the start of the event on January 30th AND please bring your ID with you to the event.**
The information collected in this form will only be used for security purposes during the Apache Kafka® Meetup which will be hosted at Amazon on January 30th.
***
NOTE:
- Please bring your ID, it is necessary to obtain an ID badge.
- Last guest entry at 6:00pm due to security purposes. Please plan accordingly!
🗓 Agenda:
- 5:00pm: Doors open/Welcome
- 5:00pm - 6:00pm: Food, Drinks & Networking
- 6:00pm - 6:30pm: Hellmar Becker, Senior Sales Engineer, Imply
- 6:45pm - 7:30pm: Lucas Brutschy, Senior Software Developer II, Confluent & Bruno Cadonna, Senior Software Developer II, Confluent
- 7:30pm - 7:45pm: Additional Q&A & Networking
***
💡 Speaker One:
Hellmar Becker, Senior Sales Engineer, Imply
Title of Talk:
Real Time Analytics with Kafka and Druid
Abstract:
Apache Druid is a high performance, relatively time, distributed OLAP database. I am going to talk about origin story of Druid, and I will show in a live demo why Druid and Kafka are a match like peanut butter and jelly, for real time analytics.
Bio:
Hellmar has worked in the software industry for more than 20 years in various pre- and postsales roles. He has worked with large customers in the finance, telco and retail industries, including a full time position at ING Bank for 3 years. He lives near Munich, Germany, with his wife and four kids. In his free time, he likes to read, and to travel with his family.
***
💡 Speaker Two:
Lucas Brutschy, Senior Software Developer II, Confluent &
Bruno Cadonna, Senior Software Developer II, Confluent
Title of Talk:
Restoring Restoration's Reputation in Kafka Streams
Abstract:
Restoring local state in Kafka Streams applications is indispensable for recovering after a failure or for moving stream processors between Kafka Streams clients. However, restoration has a reputation for being operationally problematic, because a Streams client occupied with restoration of some stream processors blocks other stream processors that are ready from processing new records. When the state is large this can have a considerable impact on the overall throughput of the Streams application. Additionally, when failures interrupt restoration, restoration restarts from the beginning, thus negatively impacting throughput further.
In this talk, we will explain how Kafka Streams currently restores local state and processes records. We will show how we decouple processing from restoring by moving restoration to a dedicated thread and how throughput profits from this decoupling. We will present how we avoid restarting restoration from the beginning after a failure. Finally, we will talk about the concurrency and performance problems that we had to overcome and we will present benchmarks that show the effects of our improvements.
Bios:
Bruno is a committer and PMC member for Apache Kafka and a Software Developer at Confluent. At Confluent he has worked on Kafka Streams, Java Kafka clients, and ksqlDB. Prior to Confluent he was a Software Developer at SAP where he worked on a distributed in-memory computing engine for Big Data. Bruno holds a Ph.D. in Computer Science from the Free University of Bozen-Bolzano, Italy, and he held a postdoc position at Humboldt-Universität zu Berlin. His academic research focused on data stream and event processing. Bruno loves well-written code and hates inline comments.
Lucas is a Kafka committer working on Kafka Streams and Java clients. He is a born Berliner, and after acquiring a PhD from ETH Zurich, where he worked on program analysis for data stores with weak consistency guarantees, he moved back to Berlin. He joined HERE Technologies (formerly Nokia Maps), where he worked on large-scale data processing for location-based data, before joining Confluent in 2022.
***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
NOTE: We are unable to cater for any attendees under the age of 21.
***
If you would like to speak or host our next event please let us know! community@confluent.io