Data Engineer Things - First Seattle Meetup!

6pm: eat food, meet your Seattle DET community

6:30pm: a quick overview of DET

6:40pm:
Vlad Sydorenko
"Data Bridge: How Netflix Abstracts Out Data Movement"
Abstract: Netflix has a ton of data. It also uses a lot of different systems to store and process the data. How do we make the same data available in multiple systems without losing sanity? And how do we maintain dozens of connectors between different systems? We’ll discuss Data Bridge - a novel data movement abstraction that aims to hide the internal complexity from end users while remaining flexible and feature-rich.

7:10pm:
Manfred Moser
"Big Data Whirlwind Tour"
Abstract: The ecosystem around big data analytics is huge, and full of confusing terms. Newcomers and veterans alike are often victims of assumptions on how things work in relational databases and how easy things look on the surface. In this session, Manfred Moser, a software and data engineer and expert for the Trino query engine, provides an overview and explanation for different components of a big data platform. He compares and explains concepts like relational database and object storage systems, storage and compute separation, file and table formats, metastores and catalogs, and other technical details. He discusses the Trino query engine as a massively parallel processing tool for different data sources and compares it to other systems. Lastly we round out the discussion talking about SQL, Python, client tools and different workloads including analytics and ETL/ELT.

7:40pm: raffle for copies of "Trino; The Definitive Guide" by Manfred Moser, networking