What we’re about
This meetup is focused on the Future of Data and the open community data projects governed by the Apache Software Foundation. Geared towards developers, data scientists and ALL Data enthusiasts who are building modern data applications. Our meetups cover all data -- data-in-motion and data-at-rest. Meetups provide an opportunity to listen, share and work hands on with other technologists in the open source and open community Apache tools.
Upcoming events (1)
See all- Apache Airflow Meetup - BangaloreCloudera, Bengaluru
### Meetup: Scaling Apache Airflow – Community Meetup in Collaboration with Astronomer
📅 Date: September 20, 2025
🕜 Time: 1:30 PM – 4:00 PM IST
📍 Location: Cloudera Office, Bangalore
👥 Hosted by: Future of Data – Bangalore, in collaboration with Astronomer***
Join us for an insightful in-person Apache Airflow Meetup, hosted at the Cloudera Bangalore office, where we’ll dive deep into real-world challenges, innovative solutions, and best practices from industry experts and contributors. This is a fantastic opportunity to meet fellow Airflow users, partners, and engineers, and discover how organizations are scaling Airflow for critical workloads.
Whether you're an Airflow user, contributor, or just getting started — you're welcome!***
### 🔥 Agenda
1:30 PM – 2:00 PM: Arrival & Settling In
2:00 PM – 2:30 PM: Talk 1 – Breaking the Connection: Why Airflow Tasks No Longer Touch the Database
Speaker: Amogh Desai, Senior Software Engineer at Astronomer & Apache Airflow PMC Member
2:30 PM – 3:00 PM: Talk 2 – Topic & Speaker: Shubham Raj
Details to be announced soon
3:00 PM – 3:30 PM: Talk 3 – GenAI based log summarization and mitigation steps at Uber
Speaker: Sameer Raj & Atish Anand, Uber
3:30 PM – 4:00 PM: Networking & Snacks***
### 🎤 Featured Talk Highlight
#### Breaking the Connection: Why Airflow Tasks No Longer Touch the Database
Speaker: Amogh Desai, Senior Software Engineer, Astronomer & Apache Airflow PMC Member
Airflow tasks traditionally had direct access to the internal database — a design that caused scalability, security, and dependency issues. With AIP-72, Astronomer introduces a radical improvement: running tasks in isolated environments that communicate with Airflow via a lightweight API. Learn how this new approach enables:- Better security with isolated execution
- Elimination of dependency conflicts
- Task execution on any infrastructure
- Simplified development experience
Speaker: Sameer Raj & Atish Anand, Uber
Piper (an Apache Airflow fork) serves hundreds of teams at Uber, with ~200k pipelines, and 800k tasks run in a day.
With huge scale comes the huge responsibility of supporting users, with >300 support queries a week. This huge inflow of queries is overwhelming for the on-call engineer to tackle, leading to delays in resolution. The queries, for example, can be like "Why did my task fail?", "Why was my pipeline paused?", "Can you help me with writing a task to upload a file to HDFS?", etc.
Thus, to solve this, we leveraged GenAI and developed agents.
The support resolution rate is 45%.***
💬 Want to present, collaborate, or volunteer at future meetups?
Feel free to reach out — we’re always open to community contributions!
🔗 RSVP now and block your seat – limited capacity!***
