Jupyter notebooks at Netflix - Reusable execution in production using Papermill
Details
Description: Notebooks have traditionally been a tool for drafting code and avoiding repeated expensive computations while exploring solutions. The Machine Learning space has used these extensively as a place to prototype and explore. To productionalize these findings usually required rewriting your code in a new system because notebooks were a mutable, human oriented platform. However with tools like nteract's papermill library, notebooks can now be reused and templatized into functional objects. This opens the door for notebooks to become reusable templates that combine code, logs, and reproducibility into one document.
We'll walk though what Jupyter notebooks are and how they are being programmatically used at Netflix, as well as how notebooks can be used with various other cloud platforms like Google Cloud. Using GCP and adjacent tools, we'll explore how notebooks make a great reproducible log of execution and act as a sharable medium for useful integration patterns.
Speaker Bio: Matthew Seal is a senior software engineer at Netflix, where he works on scaling data platform solutions. Based in the Bay Area of California, Matthew attended Stanford University for undergraduate and graduate school. He stayed in the area, working at startups and spending a long stretch of time working at OpenGov.
Agenda
5:45 - 6:30 PM Networking/Social/Food
6:30 - 6:35 PM Introduction
6:35 - 7:30 PM Talk and Q&A
7:30 - 8:00 PM Networking/Social/Closing
