Kafka 101 and Choose Your Own Topology, A Kafka Streams Adventure

Hello Kafkateers!

In order to do our part to help flatten the curve of the spread of COVID-19, we are moving all of our meetups online for the time being. Please find the details to join this meetup below.

Agenda:
6:20pm-6:30pm (US Central Standard Time): Online Networking (feel free to BYOB!!)

6:30pm-7:15pm: Getting Down to Basics - Kafka 101, Kat Grigg, Senior Technical Acct. Mgr, Confluent

7:15pm-8:00 pm: Choose Your Own Topology, A Kafka Streams Adventure, Anna McDonald, Senior Technical Acct. Mgr, Confluent

8:00 pm-8:30 pm: Q&A and online networking

Joining our slack space is not instant, so ensure that you are in, in time for the event, follow the steps within this link before the day of the event if you can! https://launchpass.com/confluentcommunity

Speaker One:
Kat Grigg, Senior Technical Acct. Mgr, Confluent

Title of Talk:
Getting Down to Basics - Kafka 101

Abstract:
This presentation will cover the basics of Apache Kafka. Why would you use Kafka in your application? What is the overall architecture of Kafka? How does Kafka process messages and how does it store messages? How is data serialized? In this talk, I will be covering the basic internals of Kafka and how these components integrate together including brokers, topics, partitions, consumers and producers, replication, and Zookeeper. I will also talk about the types of problems people are providing solutions for with Kafka.

Speaker Two;
Anna McDonald, Senior Technical Acct. Mgr, Confluent

Title of Talk:
Choose Your Own Topology, A Kafka Streams Adventure

Abstract:
Designing the perfect Kafka Streams topology for your events can be a challenge -- How should you configure your input Kafka topics? Is your target topology stateless or does it have to be stateful? What keys should you use for partitioning data and how will that selection impact join, groupBy and other operations? How should you manage state store size in RocksDB? What processing semantics do you need? Should you use session or windowed operations? Those are just some of the questions that need to be answered when designing a new Kafka Streams topology. In this presentation I will discuss the information needed to make major design decisions in Kafka Streams along with the associated pitfalls. The resulting decision map will serve as a basic guide and help lead the way on your journey to find the perfect topology!

----

Online Meetup Etiquette:
•Please unmute yourself when you have a question.
•Please hold your questions until the end of the presentation or use the zoomchat!
•Please arrive on time as zoom meetings can become locked for many reasons (though if you get locked out a recording will be available, but you may have to wait a little while for it!

----
If you would like to speak or host our next event please let us know!