What we’re about
🌟 Welcome to the Bay Area Apache Airflow Enthusiasts Meetup! 🚀
Are you passionate about orchestrating data workflows, automating tasks, and streamlining data pipelines? Join us in the heart of Los Angeles, where we gather to explore the exciting world of Apache Airflow.
🧠Who Are We?
We are a community of data engineers, developers, data scientists, and cloud enthusiasts who share a common interest in Apache Airflow. Our goal is to create a vibrant platform for learning, networking, and collaboration.
🔍 What Do We Do?
- Discover the latest trends and best practices in data orchestration.
- Share real-world use cases and success stories.
- Dive into hands-on workshops and tutorials.
- Connect with like-minded professionals in the field.
- Foster a supportive and inclusive environment for all skill levels.
🙋‍♀️ Who Should Join?
Whether you're a seasoned Apache Airflow pro or just getting started, this meetup is for you! Our diverse group welcomes beginners, experts, and everyone in between who is eager to expand their knowledge and skills in data orchestration.
đź’ˇ Why Join Us?
By joining the Bay Area Apache Airflow Enthusiasts, you'll gain valuable insights, make new connections, and stay at the forefront of this dynamic field. Plus, you'll be part of a vibrant community passionate about driving innovation in data automation.
Ready to embark on this journey with us? Join our meetup group today and be part of the exciting Apache Airflow discussions in the Bay Area!
This group is brought to you by Astronomer
Upcoming events (4)
See all- Network event43 attendees from 21 groups hostingAirflow Monthly Virtual Town Hall- AugustLink visible for attendees
PLEASE NOTE- YOU MUST REGISTER HERE TO JOIN
Join Apache Airflow committers, users, and community leaders for our Monthly Airflow Town Hall! This one-hour event is a collaborative forum to explore new features, discuss AIPs, review the roadmap, and celebrate community highlights.
The Town Hall happens on the first Friday of each month and will be recorded for those who can't attend. Recordings will be shared on Youtube and posted to the #town-hall channel on Airflow Slack and the dev mailing list.
Agenda
- Arrivals & Introduction
- Project Update
- PR Highlights
- Deadline Alerts Deep Dive
- Community Spotlight
- Closing Remarks
PLEASE NOTE- YOU MUST REGISTER HERE TO JOIN
- Airflow in the Wild: K8s, DAGs, and Operational ZenSamba TV, San Francisco, CA
Join fellow airflow enthusiasts and leaders at Samba TV's Office for an evening of engaging presentations, delicious food and drinks, and exclusive new Airflow t-shirts!
From Samba’s K8s setup to Astronomer’s self-aware pipelines, real Airflow lessons from real Airflow teams.
PRESENTATIONS
Samba Airflow: The Good, The Bad, and The Ugly
- Speaker: Piotr Kostrzeński, Software Engineer at Samba TV
- Running Apache Airflow on Kubernetes isn’t always smooth sailing. In this talk, Piotr Kostrzenski walks through Samba’s Airflow deployment, from initial setup to production challenges. You'll hear what went well, what broke spectacularly, and how the team adapted their infrastructure to support large-scale data workflows. It’s a candid, behind-the-scenes look at the realities of orchestrating Airflow in a containerized world.
How the Airflow Company Uses Airflow
- Speaker: Steven Hillion, SVP of Data & AI at Astronomer
- Astronomer’s data team recently underwent a major transformation in how we use Apache Airflow. In response to several operational challenges, we re-architected our workflows to improve reliability, scalability, and observability. This shift involved adopting dataset scheduling and breaking down our pipelines into micro-pipelines to reduce failure rates and boost overall stability. We also implemented robust observability tools to manage complex dependencies and gain full end-to-end visibility into our pipelines. To streamline onboarding and support growth, we standardized the use of Task Groups across our workflows. With Airflow now managing itself more effectively, we’re able to refocus on delivering value through data rather than wrestling with infrastructure. As a testament to these improvements, we’ll be sharing some of our favorite stats from the terabyte of data we process daily—offering a unique look into how data teams around the world are leveraging Airflow.
Dynamic DAGs in Airflow
- Speaker: Clayton Cole, Senior Data Engineer at Samba TV
- In this talk, Clayton Cole will explore how to support and scale Dynamic DAGs in Apache Airflow. As data teams grow and workflows become more complex, the need for flexibility and automation in DAG generation becomes critical. Clayton will walk through key patterns, best practices, and lessons learned from building dynamic pipelines that adapt to changing data, configurations, and operational needs. Whether you're new to Dynamic DAGs or looking to level up your implementation, this session will provide practical insights and real-world examples to help you make the most of Airflow’s dynamic capabilities.
AGENDA
- 5:30-6PM: Arrivals, eat, drink, and network
- 6-7:40PM: Presentations
- 7:40-8:30PM: Networking
- Network event104 attendees from 26 groups hostingBeyond Analytics: The DataOps ConferenceLink visible for attendees
Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.
- 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
- âť—Please Note: you must register on the event page here to save your spot.
WHAT TO EXPECT AT BEYOND ANALYTICS
- Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
- Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
- Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.
BECOME A CERTIFIED AIRFLOW 3 EXPERT
Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).FEATURED SPEAKERS
- Ryan Delgado: Director of Engineering at Ramp
- Julian LaNeve: CTO at Astronomer
- Jacob Dodd: Senior Machine Learning Engineer at Laurel
- Pete DeJoy: Co-Founder & CPO at Astronomer
BRINGING TOGETHER THE DATA ECOSYSTEM
Beyond Analytics is presented by Astronomer and supported by the following partners.âť—Please Note: you must register on the event page here to save your spot.
- Network event102 attendees from 21 groups hostingAirflow Summit 2025Hyatt Regency Seattle, Seattle, WA
Join us at the Airflow Summit in Seattle from October 7-9, 2025, for a deep dive into the future of data with Airflow 3.0. Connect with over 500 professionals, explore 100+ expert-led sessions, and participate in hands-on workshops to expand your knowledge and skills in the Apache Airflow ecosystem. Don’t miss out on this exciting event to shape the next era of data workflows!
PLEASE NOTE-YOU MUST REGISTER HERE TO SECURE A TICKET
Visit the Airflow Summit website to get your ticket and learn more!
PLEASE NOTE-YOU MUST REGISTER HERE TO SECURE A TICKET
