Details
Talk #1: What's new with Airflow?
Speaker: Ash Berlin-Taylor
Abstract: Airflow project updates & upcoming new features.
-------
Talk #2: Airflow@King - The Good, the Bad & the Ugly?
Speaker: Nathan Hadfield (Principal Data Warehouse Engineer at King) & Nicholas Brenwald (Principal Engineer at King)
Abstract:
King uses Airflow across multiple independent teams to ingest and process many Terabytes of data each day using both Cloud Composer and in-house instances built upon the main project. What were some of the reasons that led to this scenario, what’s been successful, what are the challenges and where are we going?
-------
Talk #3: Introduction to 'Breeze': the super productive Airflow development environment
Speaker: Jarek Potiuk, Principal Software Engineer at Polidea & Airflow committer
Abstract:
Here's a description of the talk from Jarek: "This talk is mainly about making life better for developers of Apache Airflow. It’s been born out of frustrations of first-time Airflow developers we had when we joined the project almost a year ago. As we remember it now - the time it took to setup the test and development environment was counted in days rather than minutes. Also, it was not easy to understand how we can easily iterate over tests, how we can effectively run tests in different variants of the Airflow environment and how to make sure that what we submit a PR that will flawlessly pass Travis CI builds. Since we had a team working on Airflow, we had to figure out how to efficiently share the environment between the developers in our team. Initially, we developed a really nice development environment for ourselves just to speed up our work, but we understood others have the same problems, so we decided to bring the experience we had into the mainstream of Airflow development."
