Big Data with Scala and Scio at Spotify
Details
- 18.00 Light food and mingle
- 18.30 Welcome
- 18.35 Scio at Spotify - Naheon Kim
At Spotify we use Scio (https://spotify.github.io/scio) and Google Dataflow for data processing.
Data infrastructure is fed data from global users meaning it is not easy to process data at this scale even though we have powerful engines.
As an engineer in a data infrastructure team implementing user privacy products I will share how we use Scio to manage user data in safety and at scale, and also what I've learned last half year at Spotify.