Adding data quality checks to DAGs using the Great Expectations Airflow Operator

Great Expectations is an open source tool for validating, documenting, and profiling your data to maintain quality and improve communication between teams. And now there's an Airflow operator for it!

We welcome Benji Lampel, who will show how the GreatExpectationsOperator is used to easily add data quality checking to ETL/ELT pipelines.

Benji is an Airflow Engineering Advocate at Astronomer focusing on data quality. His work involves understanding real-world data quality problems and creating DAGs with modern tools and patterns to solve them.

Join us and learn!