Skip to content

Details

Agenda:
6:00 - 6:30 pm: Check in, food, networking
6:30 - 6:35 pm: Intros
6:35 - 8:30 pm - 3 Talks
8:30 - 8:45 pm - Wrap up

Important Note: It is required to register for the event (free) on ti.to, before the event. You will then be sent an eNDA which needs to be signed 24 hours before the event, for security reasons. A badge would be pre-printed for you when you arrive at the event. Please register here (https://ti.to/big-data/data-science-best-practices-and-productivity). If for some reason you are not able to sign the eNDA online, you can still attend, however you may have a wait in a long line at the sign in desk.

Talk #1: Disrupting data discovery
Before any analysis can begin, a data scientist needs to discover the right data sources, understand them and trust them. Most of the time, this is done through slacking coworkers, which is very inefficient and not scalable. We will discuss how we solved this issue by building Amundsen: a map of Lyft’s data, powered by rich metadata and leveraged by an intuitive search interface.

Speakers Bio:
Jin Hyuk Chang is a software engineer at Lyft data platform team working on various data products. Jin is a main contributor to Apache Gobblin, and Azkaban. Previously, Jin worked at Linkedin and Amazon Web Service focused on Big data and Service oriented architecture.
Phil Mizrahi is an Associate Product Manager in the Data Discovery team at Lyft. Previously, Phil worked in a Fintech startup in Berlin, in an Investment Bank in Paris and served as an Officer in the French Air Force.

Talk #2: Scaling data lineage at Netflix to improve data infrastructure reliability and efficiency
Data lineage plays a central role at Netflix to improve platform reliability by forecasting accurate job SLAs while also increasing company-wide trust in the data, enhancing developer productivity by providing better visibility into data movement and enhancing efficiency of the data infrastructure by establishing appropriate data retention levels. Please join us to understand how Netflix built a centralized lineage service to better understand the movement and evolution of data and related data artifacts within the company's data warehouse

Speaker bios:
Di Lin is a senior data engineer on the infrastructure and information security team at Netflix, where he focuses on building and scaling complex data systems to help infrastructure teams improve reliability and efficiency. Previously, he was a data engineer at Facebook, where he built company-wide data products related to identity and subscriber growth.
Girish Lingappa is a senior data engineer on the infrastructure and information security team at Netflix, helping build applications and data assets aimed at building an efficient and intelligent platform. Previously, he spent several years solving various data problems at a few bay area tech companies.

Talk #3: Manage Data Like Code
In this talk, Michael and Aleksey will use examples from their experience working with messy transit data and building traffic demand models to motivate Continuous Data Integration and Delivery (CDID), a process inspired by CI/CD workflows in software development for managing, testing and versioning heterogeneous data sets. CDID automates data quality checks for a pipeline to ensure consistency, reduce bugs and avoid costly production pipeline failures.

Speaker Bio:
Michael Sindelar is Director of Engineering at Quilt Data. Before Quilt, Michael developed ML pipelines to predict mobility and traffic patterns in cities at Sidewalk Labs and at Uber.
Aleksey Bilogur is a Data Scientist and Developer Advocate at Quilt Data. He is a recent graduate of the Recurse Center and formerly worked at Kaggle.

Related topics

You may also like