Scaling Smarter with Apache Airflow®

In today’s data-driven world, Apache Airflow has become a go-to tool for orchestrating complex workflows and ensuring seamless data integration. As organizations scale, however, new challenges emerge—from handling large volumes of data to managing intricate dependencies.
Join us for a dynamic meetup exploring what it takes to scale Airflow effectively.

Marion Azoulai, Senior Data Scientist at Astronomer, will kick "A New DAG Paradigm: Less Airflow, More DAGs." She’ll dive into how Astronomer’s data team reimagined DAG design to reduce sensor overhead, improve reliability, and streamline orchestration using dataset-driven scheduling and Control DAGs.

Next David Beňo and Jaroslav Knap from MSD Czech Republic will kick things off with insights from running Airflow in a large-scale enterprise setting. They'll share their architectural strategies, successes, and hard-won lessons from the field.

Whether you're running Airflow in production or just getting started, this event is packed with practical insights and expert guidance to help you build smarter, more scalable data pipelines.

Why Attend?

• Gain Insights: Learn from the experiences of seasoned professionals who have successfully scaled Airflow in their organizations.
• Network with Peers: Connect with fellow data engineers, scientists, and industry experts who share your passion for data orchestration.
• Interactive Q&A: Participate in a lively Q&A session where you can ask questions and discuss challenges you face in your own projects.

Who Should Attend
This meetup is ideal for data engineers, data scientists, DevOps professionals, and anyone interested in enhancing their knowledge of data orchestration tools and practices. Whether you are new to Airflow or looking to optimize your existing workflows, this event promises valuable insights and practical takeaways.

Agenda:

• 18:00 - 18:30 Registration
• 18:30 – 18:40 Welcome and Introduction
• 18:40 – 19:20 "A New DAG Paradigm- Less Airflow, More DAGs", Marion Azoulai, Senior Data Scientist, Astronomer
• 19:2O – 20:00 "Airflow at Scale: Lessons Learned", David Beňo & Jaroslav Knap
• 20:00 - 21:00 - Q&A Session and Networking

See you there!
MSD Czech Republic & Astronomer