Skip to content

Think of ksqlDB Before Using Kafka Streams

Photo of Alice Richardson
Hosted By
Alice R.
Think of ksqlDB Before Using Kafka Streams

Details

Hello Streamers!

Please find the details to join this fun and informative meetup below.

Find information about upcoming meetups and tons of content from past Kafka Meetups all over the world:
cnfl.io/meetup-hub

Agenda (time below is GMT+1):
6:00pm-6:05pm: Online networking (optional)

6:05pm-6:50pm: Think of ksqlDB Before Using Kafka Streams, Patrick Neff, BAADER

6:50pm-7:00pm: Q&A

Speaker: Patrick Neff, Baader

Title: Think of ksqlDB Before Using Kafka Streams

Abstract:
A streaming data pipeline typically consists of data transformation, wrangling, and (time-based window) aggregation. On top of that, we must also guarantee data integrity. One might think of Kafka Streams to solve all these challenges, and it is definitely a good choice. However, in many cases, ksqlDB queries are simpler, faster to implement, and work fine.
In this session, a live demo for an IoT data pipeline is presented and executed with both frameworks - Kafka Streams and ksqlDB. We look at Kafka Streams topology patterns, focus on ksqlDB aggregation and scalar functions - such as lambda functions - talk about great feature releases as well as explain how to work with Confluent Schema Registry in Kafka Streams and ksqlDB.

Finally, takeaways are provided about ksqlDB’s advantages, drawbacks, limitations, and edge cases from personal experience.

Bio:
Patrick Neff is a Data Scientist and Software Developer at BAADER - a global provider of fish and poultry processing machines - in Hamburg, Germany. Patrick has a statistical background and gained comprehensive expertise in data-related technologies, such as Apache Kafka and machine learning. He published several blog articles about data science with streaming data. Patrick enjoys sharing his experiences and has presented at the Kafka Summit Europe 2021.

Don’t forget to join our Forum and Community Slack Team! https://www.confluent.io/community/ask-the-community/

If you would like to speak or host our next event please let us know! community@confluent.io

Photo of Hannover Apache Kafka® Meetup by Confluent group
Hannover Apache Kafka® Meetup by Confluent
See more events