Vertica x Apache Kafka® meetup

Join us for an Apache Kafka® x Vertica Data Analytics meetup on March 13th from 6:00pm in London at the Confluent London office.

📍Venue:
1 Bedford St
London WC2E 9HG

***
🗓 Agenda:

• 6:00pm: Doors open
• 6:00pm - 6:30pm: Pizza, Drinks and Networking
• 6:30pm - 7:15pm: Tracking aircraft in near real-time using a Raspberry Pi, Kafka, and Vertica
• 7:15pm - 8:00pm: Spinning up an Event Streaming Environment from Scratch with Confluent Cloud, Terraform, Connectors and KSQL in Action
• 8:00pm - 8:30pm - Additional Q&A & Networking

***
Session 1: Tracking aircraft in near real-time using a Raspberry Pi, Kafka, and Vertica
Speaker: Mark Whalley, Manager, Technology and Analytics, OpenText Learning Services

Using a small number of Raspberry Pi “radars'' in Geneva, Moscow, New York and Pennard, collecting ~100m messages per day from aircraft transponders, we stream data into a Vertica database via Apache Kafka. With over 100bn historic records, and live data streaming in 10-second micro batches, we have prepared a number of dashboards to demonstrate having a live conversation with the Vertica database. In this we are using some of the hundreds of in-database analytic, data preparation and machine learning Vertica SQL functions. The dashboards include the latest positions of aircraft, flight tracks, gap filling & interpolation and sessionisation – to name but a few.

This short presentation will provide a high-level overview of the project from aircraft to dashboard and introduce the Vertica Analytic Database (and Kafka) at a very high level.

***
Session 2: Spinning up an Event Streaming Environment from Scratch
Confluent Cloud, Terraform, Connectors and KSQL in Action

Speaker: Sven Erik Knop, Team Lead, Professional Services, Confluent

According to Wikipedia, Infrastructure as Code is the process of managing and provisioning computer data center resources through machine-readable definition files, rather than physical hardware configuration or interactive configuration tools. This also applies to resources and reference data, connector plugins, connector configurations, and stream processes to clean up the data.

In this talk, we are going to discuss the use cases based on the Network Rail Data Feeds, the scripts used to spin up the environment and cluster in the Confluent Cloud as well as the different components required for the ingress and processing of the data.

This particular environment is used as a teaching tool for Event Stream Processing for Kafka Streams, ksqlDB, and Flink. Some examples of further processing and visualisation will also be provided.

🌟 Whether you're a data professional, a tech enthusiast, or just curious about data analytics, this meetup is the perfect opportunity to expand your knowledge and network.

✅ Register now for a night of tech insights and networking!