Name: Best Ways to Build & Manage Airflow DAGs with Astro SDK and Astro Cloud
Start: 2022-11-14T18:30:00-06:00
End: 2022-11-14T20:30:00-06:00
Location: Improving

Sponsored by Astronomer.io and hosted by Improving MN (1515 Central Ave NE #100, Minneapolis, MN 55413).

Come join us at the next Twin Cities Data Engineering Meetup where Astronomer, the commercial developer and steward of the OSS Apache Airflow and OpenLineage projects, aims to democratize modern data orchestration for the data practitioner, from individual developers to enterprise-wide platform owners.

Remote option may be available and will be sent to attendees before event.

\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
AGENDA
\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
6:15 PM => Food (provided), networking
7:00 PM => Announcements / Who's Hiring?
7:05 PM => Main presentation
8:00 PM => Networking

\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
ABSTRACT
\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
Authoring DAGS has come a long way from the days of Airflow 1 with the introduction of the TaskFlow API in Airflow 2.0, new types of Operators and the release of the Astro SDK. We'll demonstrate the evolution of an Airflow data pipeline orchestrating a Snowflake DWH from traditional DAG writing practices to incorporate newer Airflow features that simplify DAG authoring and enable repeatable patterns. For those new to Airflow, we'll also build the same pipeline using the Astro Cloud IDE, which incorporates the design and testing of SQL/Python business logic into the DAG creation process without all the Airflow scaffolding.

\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-
SPEAKER BIO (COMING SOON)
\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-

Donald Sawyer

Twin Cities Data Engineering Meetup (Formerly TCSHUG)

Technology

Open Source

Hadoop

Big Data

Machine Learning

Data Analytics

Data Science

Best Ways to Build & Manage Airflow DAGs with Astro SDK and Astro Cloud

Data Engineering

Data Management

Improving

Share

Twin Cities Data Engineering Meetup (Formerly TCSHUG)

Best Ways to Build & Manage Airflow DAGs with Astro SDK and Astro Cloud

Twin Cities Data Engineering Meetup (Formerly TCSHUG)

Details

Members are also interested in