Skip to content

Solving data problems at Twitter scale using Scio and Dataflow

Solving data problems at Twitter scale using Scio and Dataflow

Details

Hi everyone,

We have an interesting talk this time around from the engineers at Twitter. Please note that the prerequisites for the session is understanding the basic of Scala.

We will have half an hour for welcoming you and registration and then the talk will start at 7:00PM. Don't miss this!

Speakers
Pramiti Goel & Ketan Chandak

Description
The talk will cover the following:
- What is Scio?
- How/why we choose scio for dataflow, some high level detail about the internal scio library.
- Using DAL to read/write data across different sources in different formats.
- A short demo of how a scio dataflow job using DAL looks like for us, the final corresponding State Bird app, EE and BQ dataset
- Potential other use cases & take aways

Venue
Twitter SG Office
138 Market Street
#20-01
CapitaGreen
Singapore 048946

COVID-19 safety measures

Masks required
COVID-19 vaccination required
Event will be indoors
The event host is instituting the above safety measures for this event. Meetup is not responsible for ensuring, and will not independently verify, that these precautions are followed.
Photo of Singapore Solution Architect group
Singapore Solution Architect
See more events
Twitter
138 Market St · Singapore