Skip to content

Simplifying data pipelines with Apache Flink®Stream Processing for Apache Kafka®

Photo of Alice Richardson
Hosted By
Alice R.
Simplifying data pipelines with Apache Flink®Stream Processing for Apache Kafka®

Details

Hello streamers! Please join us for an IN-PERSON Apache Kafka® meetup on Tuesday, September 26th hosted by our friends at Thinkport GmbH!

****Very Important, please note: Space is limited for this meetup. If you register, please be aware we are holding a spot for you and if you are unable to attend, please update your registration to allow space for others to join as there will more than likely be a waitlist. Many thanks! ******

📍Venue:

Thinkport GmbH

Arnsburger Str. 74

60385 Frankfurt am Main

***

🗓 Agenda:

  • 6:00pm: Doors open
  • 6:00pm-6:30pm: Snack, drinks and networking
  • 6:30pm-7:00pm: Stream Processing for Apache Kafka: Comparing Kafka Streams, ksqlDB and Flink, Perry Krol, Sr. Manager, Solutions Engineering, Confluent
  • 7:00pm-7:30pm: Simplifying data pipelines with Apache Flink, Thomas Iffland, Sr Cloud Engineer, Thinkport
  • 7:30pm-8:00pm: Additional Q&A & Networking

***

💡 Speaker One:

Perry Krol, Sr. Manager, Solutions Engineering, Confluent

Title of Talk:
Stream Processing for Apache Kafka: Comparing Kafka Streams, ksqlDB and Flink

Abstract:
In this session, we will explore the stream processing capabilities for Kafka and compare the three popular options: Kafka Streams, ksqlDB, and Apache Flink®. We will dive into the strengths and limitations of each technology, and compare them based on their ease of use, performance, scalability, and flexibility. By the end of the session, attendees will have a better understanding of the different options available for stream processing with Kafka, and which technology might be the best fit for their specific use case. This session is ideal for developers, data engineers, and architects who want to leverage the power of Kafka for real-time data processing.

Bio:
Perry Krol has spent over 2 decades designing real-time distributed business systems based on messaging middleware and event processing technology and currently leads the CEMEA Solution Engineering team at Confluent, the platform for data in motion. At Confluent since 2018, he has built and led a team that helps customers create real-time data-driven applications on Confluent's data-in-motion platform, deployed and managed across cloud, on-premises, and hybrid environments.

***

💡 Speaker Two:

Thomas Iffland, Sr Cloud Engineer, Thinkport

Title of Talk:

Simplifying data pipelines with Apache Flink

Abstract:

This talk is focused on the process of migrating from an existing application running on Kafka Streams and leveraging Kafka Connect to Apache Flink. In an era where data processing and real-time analysis are key, making the right choice in technology stack can be crucial.

By harnessing Apache Flink's capability to ingest data from various sources, such as databases and Apache Kafka, it becomes possible to streamline processes and reduce the complexity. This makes the scenario especially attractive to companies and developers looking to optimize their data processing pipelines. Confluent Schema Registry will also be included to ensure type safety.

In this live coding demo, the audience will be given a practical presentation at how this migration is performed. This is not just a theoretical overview; we will be diving into actual code, illustrating the step-by-step process involved in transitioning from Kafka Streams to Apache Flink.

During the presentation, we will explore the pros and cons of making this migration. We will also discuss the specific situations and criteria that might lead a company or developer to consider migrating.

Bio:

Thomas Iffland has been working at Thinkport since November 2022 and is part of the internal streaming team, which deals with different streaming technologies and especially Apache Kafka. Since the beginning he has been working on a project in the financial sector where Apache Kafka, Kafka Connect and Kafka Streams build the backbone of modernizing a mission critical process in the issuance of new financial products. I also love to share my knowledge about Apache Kafka in workshops.

***

DISCLAIMER

BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.

NOTE: We are unable to cater for any attendees under the age of 21.

***

If you would like to speak or host our next event please let us know! community@confluent.io

COVID-19 safety measures

Event will be indoors
The event host is instituting the above safety measures for this event. Meetup is not responsible for ensuring, and will not independently verify, that these precautions are followed.
Photo of Frankfurt Apache Kafka® Meetup by Confluent group
Frankfurt Apache Kafka® Meetup by Confluent
See more events
Arnsburger Str. 74
Arnsburger Str. 74 · Frankfurt am Main, HE