About us
🌟 Welcome to the Bay Area Apache Airflow Enthusiasts Meetup! 🚀
Are you passionate about orchestrating data workflows, automating tasks, and streamlining data pipelines? Join us in the heart of Los Angeles, where we gather to explore the exciting world of Apache Airflow.
🧠Who Are We?
We are a community of data engineers, developers, data scientists, and cloud enthusiasts who share a common interest in Apache Airflow. Our goal is to create a vibrant platform for learning, networking, and collaboration.
🔍 What Do We Do?
- Discover the latest trends and best practices in data orchestration.
- Share real-world use cases and success stories.
- Dive into hands-on workshops and tutorials.
- Connect with like-minded professionals in the field.
- Foster a supportive and inclusive environment for all skill levels.
🙋‍♀️ Who Should Join?
Whether you're a seasoned Apache Airflow pro or just getting started, this meetup is for you! Our diverse group welcomes beginners, experts, and everyone in between who is eager to expand their knowledge and skills in data orchestration.
đź’ˇ Why Join Us?
By joining the Bay Area Apache Airflow Enthusiasts, you'll gain valuable insights, make new connections, and stay at the forefront of this dynamic field. Plus, you'll be part of a vibrant community passionate about driving innovation in data automation.
Ready to embark on this journey with us? Join our meetup group today and be part of the exciting Apache Airflow discussions in the Bay Area!
This group is brought to you by Astronomer
Upcoming events
2
AI-rflow Meetup: Exploring AI Use Cases in Apache Airflow
251 Rhode Island Street, San Francisco, CA, USJoin fellow Airflow enthusiasts and leaders for a special Airflow Meetup focused on AI Use Cases in Apache Airflow.
We'll start you off with a deep dive into building an AI-Native Data Platform, and finish off with a session on the AI-Airflow feedback loop.
Come for the presentations, stay for the food, drinks, and swag!
PRESENTATIONS
Talk #1: Building the AI-Native Data Platform: How agents reshape build, serve, and compound insights from data
- Speaker: Jordan Kail, Data Engineer at Together AI
AI is changing how data platforms are designed and operated. As intelligent agents become more capable, they’re beginning to play a larger role in how teams build pipelines, serve insights, and continuously improve the value extracted from their data.
In this talk, Jordan from Together AI will explore what it means to build an AI-native data platform. One where agents help automate development, accelerate experimentation, and compound insights across systems. We’ll discuss how organizations can rethink traditional data architectures to support agent-driven workflows, scalable model deployment, and faster iteration on data products.
Attendees will walk away with a clearer picture of how AI agents are reshaping modern data infrastructure and what it takes to prepare your platform for this shift.
Talk #2: The Airflow–AI Feedback Loop and the Technology It's Inspired
- Speaker: Steven Hillion, SVP of Data & AI, Astronomer
Over the past two years, we’ve seen two concrete shifts in how leading data teams use Apache Airflow.
First, Airflow is increasingly orchestrating AI workloads: large-scale batch inference, content embedding, and evaluation pipelines including human-in-the-loop reviews. In many organizations, Airflow now coordinates not just ETL, but model lifecycle operations and agentic workflows.
Second, as AI systems become responsible for generating and modifying data pipelines, Airflow’s metadata layer — DAG structure, task state, lineage, ownership, and historical runs — becomes high-value context for AI agents. Airflow is no longer just an orchestrator; it is a structured control plane that AI systems can reason over.
This creates a feedback loop:
- Airflow orchestrates AI workloads.
- AI agents use Airflow metadata to generate, validate, and evolve pipelines.
- Human-in-the-loop patterns close the control gap.
We’ll walk through examples of this pattern and discuss the tooling it has inspired, including Astronomer's AI agent tooling, the Airflow AI SDK, and human-in-the-loop operators.
AGENDA
- 5:30-6 PM: Arrivals, networking, food & drinks
- 6-7PM: Presentations
- 7-8PM: Networking
25 attendees- Network event
Airflow Monthly Virtual Town Hall- April
·OnlineOnline71 attendees from 33 groupsPLEASE NOTE- YOU MUST REGISTER HERE TO JOIN
Join Apache Airflow committers, users, and community leaders for our Monthly Airflow Town Hall! This one-hour event is a collaborative forum to explore new features, discuss AIPs, review the roadmap, and celebrate community highlights.
The Town Hall happens on the first Friday of each month and will be recorded for those who can't attend. Recordings will be shared on the Airflow Youtube Channel and posted to the #town-hall channel on Airflow Slack and the dev mailing list.
Agenda
- Arrivals & Introduction
- Project Update
- PR Highlights
- Project Spotlight
- Community Spotlight
- Closing Remarks
PLEASE NOTE- YOU MUST REGISTER HERE TO JOIN
2 attendees from this group
Past events
37
