IN-PERSON: Demo Data You’ve Always Dreamed Of (December 2023)


Details
Hello streamers! Please join us for an IN-PERSON Apache Kafka® meetup on Tuesday, December 12th hosted by our friends at Object Computing Inc!
📍Venue:
Object Computing Inc
12140 Woodcrest Executive Dr #300
St. Louis, MO 63141
***
🗓 Agenda:
- 6:00pm: Doors open
- 6:00pm-6:30pm: Pizza, drinks and networking
- 6:30pm-7:30pm: Demo Data You’ve Always Dreamed Of, Dave Klein, Senior Developer Advocate, Tabular
- 7:30pm-8:00pm: Additional Q&A & Networking
***
💡 Speaker:
Dave Klein, Senior Developer Advocate, Tabular
Title of Talk:
Demo Data You’ve Always Dreamed Of
Abstract:
There are so many situations where developers need to generate sample data. Probably even more often for Kafka developers. Sometimes gibberish is okay, but often data that is realistic is what we really need, and that can take a lot of effort, effort that is rarely reusable.
The amount, complexity, and realistic nature of the data may change whether we are talking about a proof-of-concept, a test, or a public demonstration. So, we end up creating countless scripts to meet each need.
There are a couple of Kafka connectors that can help: DataGen, which mostly produces gibberish, and Voluble, which produces somewhat more realistic data. These can be helpful, but they require a Connect instance running and connected to your target infrastructure. If you want flexibility, more control, and the ability to generate data to targets other than Kafka, then Shadow Traffic is the tool for you.
Shadow Traffic is a commercial tool developed by Michael Drogalis, the author of the Voluble Kafka connector. In this presentation, we’ll introduce Shadow Traffic and how it works. Then we’ll produce some realistic, joinable, live data to both Kafka and PostgreSQL.
Bio:
After 28 years as a developer, architect, project manager (recovered), author, trainer, conference organizer, and homeschooling dad, Dave Klein started his developer relations journey building the Apache Kafka community at Confluent. He has migrated downstream as a senior developer advocate at Tabular, helping developers merge the worlds of streaming and batch analytics on Apache Iceberg.
***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
NOTE: We are unable to cater for any attendees under the age of 21.
***
If you would like to speak or host our next event please let us know! community@confluent.io
COVID-19 safety measures

IN-PERSON: Demo Data You’ve Always Dreamed Of (December 2023)