London Airflow Meetup at Salisbury House!

We're back at Salisbury House for our summer London Airflow Meetup! Join fellow members of the data engineering community for an evening of engaging talks, great food and drinks, and exclusive swag!

PRESENTATIONS

Talk #1: The Orchestration Layer: A Blueprint for Scaling Dynamic DAGs with Integrated Data Quality Gates

• Speaker: Vasudev Maduri, Staff Data Engineer, Admiral Group Plc

Ensuring high-quality data, accuracy, completeness, and schema validity is essential for building data trust. However, scaling data quality checks across diverse datasets often leads to duplicated boilerplate Python code, human error, and a massive bottleneck for Data Engineering teams.

In this talk, we’ll explore how to shift data quality from a backlog of tech debt into an automated, self-serve developer experience directly tied to Airflow. We will demonstrate how to build a multi-faceted data observability framework that empowers end-user teams to define their own DQ rules without writing any Python code. By hiding complex Airflow code, users simply select their parameters—YAML configurations that instantly translate into fully dynamic, end-to-end DAGs, including in-flight data quality gates.

The core of this session focuses on the technical implementation of integrated DQ checks that live directly inside the generated pipelines. You’ll learn how this metadata-driven approach enables a "shift-left" strategy for data observability, automatically enforcing data contracts and routing alerts without manual engineering intervention.

Talk #2: TBA

AGENDA

• 5:30-6 PM: Arrivals, networking, food & drinks
• 6-7:05PM: Presentations
• 7:05-8PM: Networking