Bay Area Airflow Meetup at Astronomer!

📣📣 Attention Airflow Users and Big Data Professionals 📣📣

Join us at Astronomer's offices for the First SF Bay Area Airflow Meetup of the New Year!

If you're interested in speaking, please email briana.okyere@astronomer.io

AGENDA

• 5:00 PM-5:30: Arrivals, Eat, Drink and Network!
• 5:30 PM-6:30 PM: Presentations!
• 6:30 PM- 8:00 PM: Eat more, drink more, and network!

PRESENTATIONS

Talk #1: Airflow as a Platform for MLOps

• Speaker: Steven Hillion, SVP, Data and AI at Astronomer
• Abstract: In his presentation, Steven will delve into the transformative role of Airflow in facilitating MLOps workflows. He will explore how Airflow streamlines model deployment, orchestration, and monitoring, empowering organizations to operationalize machine learning pipelines efficiently.

Talk #2: Data Quality within Airflow and Pipeline metadata

• Speaker: Gideon Kory, Data Intelligence Venturer at Collibra
• Abstract: In his presentation, Gideon will illustrate Collibra's utilization of Airflow for two key purposes. Firstly, he will discuss how Airflow facilitates the integration of Data Quality (DQ) Jobs into DAGs, enhancing data quality management within the platform. Additionally, he will highlight Collibra's implementation of Airflow to establish comprehensive lineage between datasets and pipelines, emphasizing the importance of pipeline metadata for data governance and traceability.