Introduction to Apache Airflow Workshop with Kenten Danas from Astronomer

Introduction to Apache Airflow Workshop with Kenten Danas from Astronomer

Apache Airflow is an open source tool for programmatically authoring, scheduling, and monitoring data pipelines. It has a robust and active community, and with over 1M downloads per month, it has become the de facto standard for code-based data orchestration.

In this workshop, we'll walk through everything you need to get Airflow up and running locally and start orchestrating data pipelines. We'll cover Airflow background, including core components and concepts, show a demo, and provide exercises to help you dive in and create your own pipelines. We'll leave lots of time for Q&A, and no prior Airflow or data engineering experience is necessary.

# Kenten is a Field Engineer at Astronomer with a background in data engineering, data science, and consulting. She has first hand experience adopting and running Airflow as a consultant, and enjoys helping other data engineers scale and get the most out of their Airflow experience. When she isn't working with data she's typically outside trail running, skiing, and advocating for climate action.

Audience level:
Beginners level

Schedule:
19:00 Channel opening
19:05 Pyladies and announcements
19:15 Introduction to Apache Airflow Workshop
21:00 Q&A and networking

Requirements:

• Docker and Python 3 installed locally
• Install the Astronomer CLI and try to use it to run Airflow locally, instructions for that can be found here: https://www.astronomer.io/docs/enterprise/v0.25/develop/cli-quickstart

In case you get stuck at setup feel free to reach out on the PyLadies Slack on the #city-hamburg channel

Gender policy
PyLadies aims to provide a friendly support network for women and a bridge to the larger Python world. Anyone with an interest in Python is encouraged to participate! We apply the LadyNerds Code of Conduct (http://bit.ly/LadyNerds-CoC ).

Contact
Interested in speaking at one of our events? Have a good idea for a Meetup? Get in touch with us at hamburg@pyladies.com

Slack information
Slack: https://slackin.pyladies.com
Channel: #city-hamburg

We follow the LadyNerds Code of Conduct (http://bit.ly/LadyNerds-CoC ) because we are dedicated to providing a safe, inclusive, welcoming, and harassment-free space and experience for all members and guests, regardless of gender identity and expression, sexual orientation, disability, physical appearance, socioeconomic status, body size, ethnicity, nationality, level of experience, age, or religion (or lack thereof). The Code of Conduct exists because of that dedication. We do not tolerate harassment in any form and we prioritise marginalised people’s safety over privileged people’s comfort.

Here is the global PyLadies Code of Conduct (http://www.pyladies.com/CodeOfConduct/ ).