Serving the Real-Time Data Needs of an Airport with Kafka Streams and KSQL

Join us for an Apache Kafka meetup on January 10th from 6pm to 8pm, hosted by codecentric AG in Frankfurt am Main. The address is Kreuznacher Straße 30, 60486 Frankfurt am Main. The agenda and speaker information can be found below. See you there!

-----

Agenda:
6:00pm: Doors open
6:00pm - 6:30pm: Networking, Pizza and Drinks
6:30pm - 7:30pm: Serving the Real-Time Data Needs of an Airport with Kafka Streams and KSQL, Sönke Liebau, Partner and Co-Founder ,OpenCore GmbH & Co. KG
7:30pm - 9:00pm: Additional Q&A and Networking

-----

First Talk

Speaker:
Sönke Liebau, Partner and Co-Founder, OpenCore GmbH & Co. KG

Bio:
Sönke has been working as a freelancing technical analyst in Germany since 2008. He started getting involved with big data and open source technologies around 2011 and used Kafka in many customer projects since then. In 2016 he co-founded OpenCore and has been focused on Kafka since then.

Title:
Serving the Real-Time Data Needs of an Airport with Kafka Streams and KSQL

Abstract:

Airports are complex networks consisting of an immense number of systems that are necessary to keep the daily stream of passengers in constant motion. Connecting these systems in order to make the big picture transparent to the people running the show, authorities and last but not least the passengers is no simple endeavor.

In this talk I will describe a fictional airport and its effort to restructure the IT infrastructure around Kafka Streams to serve the real-time data needs of a busy airport. I will start by giving a brief overview of Kafka Streams, KSQL and the opportunities they offer for real-time stream processing. Following that we will explore the the target architecture, which relies heavily on manifested views to serve up-to-date data, while also persisting to a traditional data lake for larger analytics workflows. Additionally we will take a look at the generic data transformation framework that was created to minimize integration effort of the data receiving systems. To illustrate these ideas I will describe some examples of possible integrations: joining flight data with radar and weather data to predict arrival time at the gate down to the second, constantly updated processing data from the luggage conveyor belts as well as results from prediction models for passenger flow, and many more.

-----

Don't forget to join our Community Slack Team! https://launchpass.com/confluentcommunity

If you would like to speak or host our next event please let us know! community@confluent.io

NOTE: We are unable to cater for any attendees under the age of 18. Please do not sign up for this event if you are under 18.