Think of ksqlDB Before Using Kafka Streams


Details
Hello Streamers!
Please find the details to join this fun and informative meetup below.
Find information about upcoming meetups and tons of content from past Kafka Meetups all over the world:
cnfl.io/meetup-hub
Agenda (time below is GMT+1):
6:00pm-6:05pm: Online networking (optional)
6:05pm-6:50pm: Think of ksqlDB Before Using Kafka Streams, Patrick Neff, BAADER
6:50pm-7:00pm: Q&A
Speaker: Patrick Neff, Baader
Title: Think of ksqlDB Before Using Kafka Streams
Abstract:
A streaming data pipeline typically consists of data transformation, wrangling, and (time-based window) aggregation. On top of that, we must also guarantee data integrity. One might think of Kafka Streams to solve all these challenges, and it is definitely a good choice. However, in many cases, ksqlDB queries are simpler, faster to implement, and work fine.
In this session, a live demo for an IoT data pipeline is presented and executed with both frameworks - Kafka Streams and ksqlDB. We look at Kafka Streams topology patterns, focus on ksqlDB aggregation and scalar functions - such as lambda functions - talk about great feature releases as well as explain how to work with Confluent Schema Registry in Kafka Streams and ksqlDB.
Finally, takeaways are provided about ksqlDB’s advantages, drawbacks, limitations, and edge cases from personal experience.
Bio:
Patrick Neff is a Data Scientist and Software Developer at BAADER - a global provider of fish and poultry processing machines - in Hamburg, Germany. Patrick has a statistical background and gained comprehensive expertise in data-related technologies, such as Apache Kafka and machine learning. He published several blog articles about data science with streaming data. Patrick enjoys sharing his experiences and has presented at the Kafka Summit Europe 2021.
Don’t forget to join our Forum and Community Slack Team! https://www.confluent.io/community/ask-the-community/
If you would like to speak or host our next event please let us know! community@confluent.io

Think of ksqlDB Before Using Kafka Streams