In-Person: Kafka Survival/Windowing in Kafka Streams and Flink SQL

Hello friends! Please join us for a combined, IN-PERSON meetup organized for NYC Kafka and NYC Flink groups to be held on Wednesday, February 21st starting from 4:30pm.

Venue:
Jay Conference Bryant Park
Event Space—Dubai Room
109 West 39th Street Grand Concourse
New York, NY 10018

***
Agenda:
4:30pm: Doors Open
5:30pm-6:45pm: Kafka Survival: Poison Pills, Schema Compatibility, Data Contracts, Florent Ramiere and Stephane Derosiaux, Conduktor
6:45pm - 8:00pm: Windowing in Kafka Streams and Flink SQL, Bill Bejeck, Confluent
8:00pm-9:00pm: Additional Q&A and Networking

***
Speakers for first talk:
Florent Ramiere, Head of Gateway at Conduktor and Stephane Derosiaux, co-founder and CTO of Conduktor

Title of Talk:
Kafka Survival: Poison Pills, Schema Compatibility, Data Contracts

Abstract:
We have built a nice application; it's up and running for days in production, crunching thousands of records per minute. Everything works fine... until it crashes.

Join us to learn how to strengthen your Kafka app against common real-world challenges like 'poison pill' data and schema compatibility issues. What are the causes and the consequences? How can we implement safety measures? We'll focus on how to identify and fix problematic data or schema changes that can crash Kafka apps, and how to handle errors using exception-handling strategies.

Next, we'll explore how to introduce proactive error testing and prevention techniques, such as Schema ID Validation. We'll cover the importance of a robust data contract validation system, ensuring errors are detected before reaching Kafka and impacting your apps.

Bios:
Florent Ramiere is passionate about technology and has more than twenty years of hands on experience in software development and project management. After a few years at Confluent as a System Engineer, he went on to build advanced products at Conduktor to help teams be more successful with Kafka.
Stephane Derosiaux is the co-founder and CTO of Conduktor. An Apache Kafka enthusiast, he's dedicated to creating the best data streaming experience for developers and organizations. He has more than 15+ years of expertise in software and data engineering, acquired through extensive large-scale Adtech and Retailtech organizations.
***
Speaker Two:
Bill Bejeck, Developer Experience Engineer, Confluent

Title of Talk:
Windowing in Kafka Streams and Flink SQL

Abstract:
Shakespeare once said that the "Eyes are the window to your soul". Had Shakespeare been a developer today, he may have changed that to "Windows are the eyes into your data."
Stream processing has become the de facto standard of working with data, with Kafka Streams and Flink being the top choices to implement an event streaming application. Responding quickly to any event is only possible when you can access those events as they happen. But in many cases, you're not concerned with one single event. Instead, it's a series of events within a given period that commands attention. In other words, it's essential to analyze events within discrete windows of time. Yet, with the different options available and the time semantics around them, windowing can be tricky to get right.
In this talk, I will cover the following topics for windowing in Kafka Streams and Flink SQL:
* Different window types (hopping, tumbling, sliding, etc.) and use-case application
* The semantics of time advancement, window closing, and the emitting of results
* Analyzing windowed results
* Testing strategies
Developers attending this presentation will gain an understanding of what windowing is in stream processing, the different types available to them, and some guidelines on when to apply which window type.

Bio:
Bill has been a software engineer for over 18 years. Currently, he is working at Confluent as a Staff DevX Engineer. Previously, Bill was an engineer on the Kafka Streams team for three-plus years. Before Confluent, he worked on various ingest applications as a U.S. Government contractor using distributed software such as Apache Kafka, Spark, and Hadoop. Bill has also written a book about Kafka Streams titled "Kafka Streams in Action" and is working on a 2nd edition (https://www.manning.com/books/kafka-streams-in-action-second-edition) that should be available Spring 2024.

***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
NOTE: We are unable to cater for any attendees under the age of 21.
***