Scaling the Ride: Lyft’s Journey with Apache Airflow®

Join fellow airflow enthusiasts and leaders at Lyft HQ for an evening of engaging presentations, delicious food and drinks, and awesome swag!

Get an update on the Airflow 3 release, and learn how companies like Lyft are using Airflow to scale their workflows.

PRESENTATIONS

Scaling the Ride: Lyft’s Journey with Apache Airflow®

• Speaker: Arbaz Mirza, Senior Software Engineer at Lyft
• As one of the largest ride-sharing platforms, Lyft relies on robust data orchestration to power everything from ETL pipelines to machine learning workflows. In this session, we’ll take you through Lyft’s journey with Apache Airflow—how we scaled our workflows, tackled operational challenges, and optimized performance for a rapidly growing data ecosystem. Learn about the lessons we’ve learned along the way, best practices we’ve adopted, and what’s next for Airflow at Lyft. Whether you're just starting with Airflow or managing it at scale, this talk will provide insights to help you navigate your own orchestration journey.

What to Expect in Airflow 3.0: The Next Evolution

• Speaker: Vikram Koka, Chief Strategy Officer at Astronomer
• Big changes are on the horizon for Apache Airflow! In this session, get an exclusive first look at what's new in Airflow 3. We'll explore key features, and enhancements, helping you understand how they impact your workflows and deployments.

Beyond SLAs: A Deep Dive into Airflow 3's New Deadline Alerts

• Speaker: Dennis Ferruzzi, Software Developer at Amazon & Apache Airflow Committer
• Do you have a DAG that needs to be done by a certain time? Have you tried to use Airflow's existing SLA feature and found it restrictive or complicated? In this talk we'll take a look at the all-new Deadline Alerts feature coming in Airflow 3 which replaces and revolutionizes SLA. We'll discuss how Deadline Alerts work and how they're different than the previous SLA feature. Then we'll look at some examples of workflows you can build with the new feature. Finally, we'll walk through some future usecases of using Deadlines for Tasks and even Assets.

AGENDA

• 5:30-6PM: Arrivals, eat, drink, and network
• 6-7:40PM: Presentations
• 7:40-8PM: Networking