IN PERSON! Apache Kafka® Meetup Nürnberg - June 2024

Join us for an Apache Kafka® Meetup on Tuesday, June 4th from 6:00pm in Nürnberg hosted by Datev!

📍Venue:
DATEV IT-Campus, Fürther Straße 111, 90429 Nürnberg
Main Entrance only!

***
🗓 Agenda:

• 6:00pm: Doors open
• 6:00pm - 6:30pm: Pizza, Drinks and Networking
• 6:30pm - 7:15pm: Harry Kimpel, Principal Developer Relations Engineer, New Relic
• 7:15pm - 8:00pm: Lucas Brutschy, Senior Software Developer II, Confluent
• 8:00pm - 8:30pm: Additional Q&A & Networking

***
💡 Speaker One:
Harry Kimpel, Principal Developer Relations Engineer, New Relic

Title of Talk:
Tracing Kafka with OpenTelemetry

Abstract:
Ideally, you should be using distributed tracing to trace requests through your system, but Kafka decouples producers and consumers, which means there are no direct transactions to trace between them. Kafka also uses asynchronous processes, which have implicit, not explicit, dependencies. That makes it challenging to understand how your microservices are working together.

However, it is possible to monitor your Kafka clusters with distributed tracing and OpenTelemetry. You can then analyze and visualize your traces in an open source distributed tracing tool like Jaeger or a full observability platform like New Relic. In this talk I will leverage a simple application to show how you can achieve this.

Bio:
Passionate software craftsman with 25+ years experience in a broad spectrum of development technologies and platforms. Mostly focusing on .NET/C#, the Microsoft development stack and cloud-native software architectures. Key focus also on Microsoft Azure as well as Amazon Web Services (AWS) and Google Cloud Platform (GCP). Observability, monitoring and securing these environments are key aspects. Currently extremely interested in the Distributed Application Runtime (Dapr).

***
💡 Speaker Two:
Lucas Brutschy, Senior Software Developer II, Confluent

Title of Talk:
Streams Don’t Fail Me Now - Robustness Features in Kafka Streams

Abstract:
Stream processing applications can experience downtime due to a variety of reasons, such as a Kafka broker or another part of the infrastructure breaking down, an unexpected record (known as a poison pill) that causes the processing logic to get stuck, or a poorly performed upgrade of the application that yields unintended consequences.

Apache Kafka’s native stream processing solution, Kafka Streams, has been successfully used with little or no downtime in many companies. This has been made possible by several robustness features built into Streams over the years and best practices that have evolved from many years of experience with production-level workloads.

In this talk, I will present the unique solutions the community has found for making Streams robust, explain how to apply them to your workloads and discuss the remaining challenges. Specifically, I will talk about standby tasks and rack-aware assignments that can help with losing a single node or a whole data center. I will also demonstrate how custom exception handlers and dead letter queues can make a pipeline more resistant to bad data. Finally, I will discuss options to evolve stream topologies safely.

Bio:
Lucas is a Kafka committer working on Kafka Streams and Java clients. He is a born Berliner, and after acquiring a PhD from ETH Zurich, where he worked on program analysis for data stores with weak consistency guarantees, he moved back to Berlin. He joined HERE Technologies (formerly Nokia Maps), where he worked on large-scale data processing for location-based data, before joining Confluent in 2022.

***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
NOTE: We are unable to cater for any attendees under the age of 21.

***
If you would like to speak or host our next event please let us know! community@confluent.io