Skip to content

On Track with Apache Kafka®: Building a Streaming ETL solution with Rail Data

Photo of Alice Richardson
Hosted By
Alice R.
On Track with Apache Kafka®: Building a Streaming ETL solution with Rail Data

Details

Agenda (Chennai time):
3:30pm-3:35pm: Online Networking
3:35pm-4:20pm: Robin Moffatt: On Track with Apache Kafka®: Building a Streaming ETL solution with Rail Data (inc. Q&A)
4:20pm: Have follow up questions afterwards? Ask them in our slack space: cnfl.io/slack

Your local timezone: http://www.worldtimebuddy.com/event?lid=1880252%2C1277333&h=1880252&sts=26859840&sln=18-19&a=show

(Find information about all upcoming meetups and tons of content from past Kafka Meetups all over the world: cnfl.io/meetup-hub)

-----

Speaker: Robin Moffatt

Title: On Track with Apache Kafka®: Building a Streaming ETL solution with Rail Data

Abstract: As data engineers, we frequently need to build scalable systems working with data from a variety of sources and with various ingest rates, sizes, and formats. This talk takes an in-depth look at how Apache Kafka can be used to provide a common platform on which to build data infrastructure driving both real-time analytics as well as event-driven applications. Using a public feed of railway data it will show how to ingest data from message queues such as ActiveMQ with Kafka Connect, as well as from static sources such as S3 and REST endpoints. We’ll then see how to wrangle the data into a form useful for streaming to analytics in tools such as Elasticsearch and Neo4j. If you’re wondering how to build your next scalable data platform, how to reconcile the impedance mismatch between stream and batch, and how to wrangle streams of data—this talk is for you!

Bios:
Robin is a Senior Developer Advocate at Confluent, the company founded by the original creators of Apache Kafka, as well as an Oracle ACE Director (Alumnus). He has been speaking at conferences since 2009 including QCon, Devoxx, Strata, Kafka Summit, and Øredev. You can find his talks online (https://talks.rmoff.net), subscribe to his YouTube channel (http://youtube.com/rmoff) (thanks lockdown!), and read his blog (http://rmoff.net/). Outside of work he enjoys drinking good beer and eating fried breakfasts, although generally not at the same time.

Speaker since 2009 at conferences including QCon, Devoxx, O'Reilly Strata, NDC, USENIX LISA, Kafka Summit, Øredev, O'Reilly SACon, Oracle OpenWorld, JavaZone, Big Data LDN, UKOUG, Oracle CODE, PGConf, etc plus numerous meetups.

Top-rated speaker at Kafka Summit, Devoxx, UKOUG.

-----
Online Meetup Etiquette:
•If you feel comfortable, feel free to turn your camera on! It helps create a more interactive environment!
•(After the talk) Please unmute yourself when you have a question or use the zoomchat if you want to ask a question during the talk!!
•Please arrive on time as zoom meetings can become locked for many reasons (though if you get locked out a recording will be available, but you may have to wait a little while for it!)

----
If you would like to speak or host our next event please let us know! community@confluent.io

Photo of Bali, India Apache Kafka® Meetup by Confluent group
Bali, India Apache Kafka® Meetup by Confluent
See more events