Skip to content

Apache Beam meetup 8: streaming SQL in Beam and Beam use-case by Huq Industries

Photo of David Sabater Dinter
Hosted By
David Sabater D. and Matthias B.
Apache Beam meetup 8: streaming SQL in Beam and Beam use-case by Huq Industries

Details

We want to invite you to join us for the 8th Beam meet up in London.

The meetup will take place on October 16th. We hope to be able to welcome you at Google this time (http://cloud.google.com) offices!

Stay tuned for speakers and topics! (we'll have a SQL deep dive and a Beam use-case)

=======
Agenda

18:30 - Registrations

18:45 - kick-off

19:00 - 1st talk: Beam use-case by Huq Industries.

19:45 - 2nd talk: Building an interactive streaming SQL engine in Beam.

20:15 - pizza, drinks and networking

=====
Talks

1st talk

For the first talk, we welcome Isambard (https://www.linkedin.com/in/isambard). Isambard is a co-founder and leads the technology team at Huq Industries (https://huq.io). Huq Industries is a geolocation company that provides data, insights and analytics into the Financial Services, Property and Out of Home Media Industries. Huq has recently migrated much of its data processing pipelines to use Apache Beam running on Google Dataflow. The talk gives some background on Apache Beam, the motivation to start using it and the problems that it has solved for us. He will also talk about some of the issues that we encountered in the adoption and how we overcame them.

2nd talk

For the second talk, we welcome David Sabater (https://www.linkedin.com/in/dsdinter), Data Specialist at Google. David will start his session by showing how the Beam SQL feature works, then we review how streaming SQL came from collaboration between the Beam, Calcite and Flink communities and the advantages over other SQL implementations. Finally, he will demo a couple of simple use cases: a pure SQL pipeline from the new SQL shell, as well as using Dataflow SQL UI in Google Cloud Platform to join streaming data from Pubsub with BigQuery.

==================
Who should attend

Everyone interested in Data Engineering, Data Science and Machine Learning, who wants to learn about one of the newer and exciting Apache projects focused on batch & stream processing of data. We try to cover both business value as well as digging deeper technically.

=========
Sponsors

Thanks to Google (about.google) for providing the space, food & drinks at this meet up.

Photo of London Apache Beam Meetup group
London Apache Beam Meetup
See more events
Google London
123 Buckingham Palace Road · London