About us
🌟 Welcome to the London Apache Airflow Meetup! 🚀
Are you passionate about orchestrating data workflows, automating tasks, and streamlining data pipelines? Join us in the heart of London, where we gather to explore the exciting world of Apache Airflow.
🧠 Who Are We?
We are a community of data engineers, developers, data scientists, and cloud enthusiasts who share a common interest in Apache Airflow. Our goal is to create a vibrant platform for learning, networking, and collaboration.
🔍 What Do We Do?
- Discover the latest trends and best practices in data orchestration.
- Share real-world use cases and success stories.
- Dive into hands-on workshops and tutorials.
- Connect with like-minded professionals in the field.
- Foster a supportive and inclusive environment for all skill levels.
🙋♀️ Who Should Join?
Whether you're a seasoned Apache Airflow pro or just getting started, this meetup is for you! Our diverse group welcomes beginners, experts, and everyone in between who is eager to expand their knowledge and skills in data orchestration.
💡 Why Join Us?
By joining the London Apache Airflow Meetup, you'll gain valuable insights, make new connections, and stay at the forefront of this dynamic field. Plus, you'll be part of a vibrant community passionate about driving innovation in data automation.
Ready to embark on this journey with us? Join our meetup group today and be part of the exciting Apache Airflow discussions in London!
This group is brought to you by Astronomer.
Upcoming events
2
London Airflow Meetup at Salisbury House!
Salisbury House, 114 London Wall, London, EC2M 5QD, London, GBWe're back at Salisbury House for our summer London Airflow Meetup! Join fellow members of the data engineering community for an evening of engaging talks, great food and drinks, and exclusive swag!
PRESENTATIONS
Talk #1: The Orchestration Layer: A Blueprint for Scaling Dynamic DAGs with Integrated Data Quality Gates
- Speaker: Vasudev Maduri, Staff Data Engineer, Admiral Group Plc
Ensuring high-quality data, accuracy, completeness, and schema validity is essential for building data trust. However, scaling data quality checks across diverse datasets often leads to duplicated boilerplate Python code, human error, and a massive bottleneck for Data Engineering teams.
In this talk, we’ll explore how to shift data quality from a backlog of tech debt into an automated, self-serve developer experience directly tied to Airflow. We will demonstrate how to build a multi-faceted data observability framework that empowers end-user teams to define their own DQ rules without writing any Python code. By hiding complex Airflow code, users simply select their parameters—YAML configurations that instantly translate into fully dynamic, end-to-end DAGs, including in-flight data quality gates.
The core of this session focuses on the technical implementation of integrated DQ checks that live directly inside the generated pipelines. You’ll learn how this metadata-driven approach enables a "shift-left" strategy for data observability, automatically enforcing data contracts and routing alerts without manual engineering intervention.
Talk #2: TBA
AGENDA
- 5:30-6 PM: Arrivals, networking, food & drinks
- 6-7:05PM: Presentations
- 7:05-8PM: Networking
21 attendees- Network event
Airflow Monthly Virtual Town Hall- April
·OnlineOnline28 attendees from 33 groupsPLEASE NOTE- YOU MUST REGISTER HERE TO JOIN
Join Apache Airflow committers, users, and community leaders for our Monthly Airflow Town Hall! This one-hour event is a collaborative forum to explore new features, discuss AIPs, review the roadmap, and celebrate community highlights.
The Town Hall happens on the first Friday of each month (unless there is a holiday) and will be recorded for those who can't attend. Recordings will be shared on the Airflow Youtube Channel and posted to the #town-hall channel on Airflow Slack and the dev mailing list.
Agenda
- Arrivals & Introduction
- Airflow Project Update
- PR of the Month Highlight
- Project Spotlight
- Community Spotlight
- Closing Remarks
PLEASE NOTE- YOU MUST REGISTER HERE TO JOIN
1 attendee from this group
Past events
31
