Apache Beam meet up 1: introduction + use case + State & Timers

Time to kick-off the Apache Beam London meet up! We managed to find 3 interesting topics to talk about in the first meet up and hope to be able to welcome you in the Qubit (http://www.qubit.com/) offices at the start of October.

Agenda

• 18:30 - Registrations, beer & pizza

• 18:45 - Kick off + 1st talk: Apache Beam intro

• 19:15 - 2nd talk: Apache Beam use case on Google Cloud Platform

• 20:00 - 3rd talk: Deep dive into state & timers

Talks

1st talk

Victor Kotai (https://uk.linkedin.com/in/kotaivictor), software engineer at Qubit, will give an overview of what Apache Beam is and why we should use it. The different, relevant concepts like Pipelines, PCollections, and Sources & Sinks will be covered as well as the different Transformations within Beam. This will set the stage for the meet up and make sure everyone is somewhat familiar with Beam before we dig deeper.

2nd talk

In the second talk, Jibran Saithi (https://www.linkedin.com/in/jibran-saithi-03b23a1/), tech lead at Qubit, will take a closer look at a use case, in which we will take advantage of Apache Beam. The business case will be covered, and we will talk about where Beam adds value, as well as the technical challenges faced during development.

3rd talk

In the 3rd talk, we’ll dig a bit deeper into internals of Beam. Reuven Lax (https://www.linkedin.com/in/reuven-lax-a82818/), senior software engineer at Google, will present one of Beam’s latest features: Stateful and Timely processing. These concepts and APIs allow you to do some lower level management in your pipeline and finetune to squeeze out more efficiency.

Who should attend

Everyone interested in Data Engineering, Data Science and Machine Learning, who wants to learn about one of the newer and exciting Apache projects focused on batch & stream processing of data. We try to give everyone the same foundations at the start of the meet up and go more expert along the way, covering both business value as well as digging deeper technically.

Sponsors

Thanks to Qubit (http://www.qubit.com/) for providing the space, food & drinks at this meet up.