What we’re about
🌟 Welcome to the Berlin Apache Airflow Enthusiasts Meetup! 🚀
Are you passionate about orchestrating data workflows, automating tasks, and streamlining data pipelines? Join us in the heart of Berlin, where we gather to explore the exciting world of Apache Airflow.
🧠Who Are We?
We are a community of data engineers, developers, data scientists, and cloud enthusiasts who share a common interest in Apache Airflow. Our goal is to create a vibrant platform for learning, networking, and collaboration.
🔍 What Do We Do?
Discover the latest trends and best practices in data orchestration.
Share real-world use cases and success stories.
Dive into hands-on workshops and tutorials.
Connect with like-minded professionals in the field.
Foster a supportive and inclusive environment for all skill levels.
🙋‍♀️ Who Should Join?
Whether you're a seasoned Apache Airflow pro or just getting started, this meetup is for you! Our diverse group welcomes beginners, experts, and everyone in between who is eager to expand their knowledge and skills in data orchestration.
đź’ˇ Why Join Us?
By joining the Berlin Apache Airflow Enthusiasts, you'll gain valuable insights, make new connections, and stay at the forefront of this dynamic field. Plus, you'll be part of a vibrant community passionate about driving innovation in data automation.
Ready to embark on this journey with us? Join our meetup group today and be part of the exciting Apache Airflow discussions in Berlin!
Upcoming events (2)
See all- Network event93 attendees from 26 groups hostingBeyond Analytics: The DataOps ConferenceLink visible for attendees
Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.
- 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
- âť—Please Note: you must register on the event page here to save your spot.
WHAT TO EXPECT AT BEYOND ANALYTICS
- Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
- Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
- Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.
BECOME A CERTIFIED AIRFLOW 3 EXPERT
Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).FEATURED SPEAKERS
- Ryan Delgado: Director of Engineering at Ramp
- Julian LaNeve: CTO at Astronomer
- Jacob Dodd: Senior Machine Learning Engineer at Laurel
- Pete DeJoy: Co-Founder & CPO at Astronomer
BRINGING TOGETHER THE DATA ECOSYSTEM
Beyond Analytics is presented by Astronomer and supported by the following partners.âť—Please Note: you must register on the event page here to save your spot.
- Berlin Apache Airflow Meetup at GetYourGuide!GetYourGuide Office, Berlin
Join fellow airflow enthusiasts and leaders at GetYourGuide's Offices for an evening of engaging presentations, delicious food and drinks, and awesome swag!
PRESENTATIONS
Airflow & dbt: dynamic creation of inter-dag sensors with cosmos
- Speaker: Giovanni Corsetti Silva, Data Core Engineer at GetYourGuide
Apache Airflow is the go-to platform for data orchestration, while dbt is widely recognized for analytical data transformations. Using astronomer-cosmos library, integrating dbt projects into Airflow becomes straightforward, allowing each dbt model to be transformed into individual tasks or task groups equipped with Airflow features like retries and callbacks.
However, organizing dbt models into separate Airflow DAGs based on domain or user-defined filters presents challenges in maintaining dependencies across these distinct DAGs. Ensuring that downstream dbt tasks only execute after the corresponding upstream tasks in different DAGs have successfully completed is crucial for data consistency—yet this functionality is not supported by default.
Join GetYourGuide as we explore our method for dynamically creating inter-DAG sensors in Airflow using Astronomer Cosmos for dbt. We will show how we maintained dbt model dependencies across multiple DAGs, making our pipeline modular, scalable, and robust.Safeguarding your workflows in Apache Airflow
- Speaker: Robert Bemmann, Senior Data Engineer at GetYourGuide
This presentation highlights practical validation techniques to prevent misconfigurations and enhance reliability in Apache Airflow environments. We cover two key safeguards: validating that sensors are correctly tied to their upstream tasks, and checking that critical DAGs have PagerDuty alerting enabled. Both validations are automated and integrated into our CI/CD pipeline using GitHub Actions, ensuring continuous enforcement and early detection of potential issues before deployment. In addition, we’ve implemented a solution to track Service Level Objectives (SLOs) for our DAGs, enabling better insight into reliability and performance over time. These checks form a practical defense against operational blind spots, promoting workflow reliability and robust incident response. Join us as we uncover practical strategies to streamline workflow monitoring and enhance system resilience using Apache Airflow's robust capabilities.
From Chaos to Cosmos: Simplifying DAG Creation in Apache Airflow
- Speaker: Tatiana Al-Chueyr Martins, Principal Software Engineer at Astronomer & Cosmos Committer
Talk Description TBD
--------------------------------------------------------------------------------------------------
AGENDA
- 18:00–18:30: Arrivals, eat, drink, and network
- 18:30–20:10: Presentations
- 20:10–21:00: Networking
