Airflow Meetup (Sep 21, 2016)

Airflow's third-ever meetup! Hosted at the Stripe offices in San Francisco.

Our address is 185 Berry Street. It's on Berry in the middle between 3rd Street and 4th Street.

From the lobby, head on up to the 5th floor.

The event starts at 6:30pm with food and drinks; the talks will begin at 7:00pm.

Talks:

Airflow @ Stripe

Speaker: Jeff Balogh

Stripe builds payments infrastructure for the internet. We switched from Luigi to Airflow in July 2015. Our main dag has more than 4,000 tasks that we run every day. I'll talk about how we use Airflow to manage our pipeline and the extensive customizations we've made to help Airflow fit into our workflow.

Airflow @ Apigee

Speaker: Ben Tallman

Apigee builds and runs tools to design, secure, analyze, and scale your APIs. We moved our internal integration and ETL processes from python scripts to Airflow in beginning in March of 2016 and process more than a thousand dags and 9,000 task instances per day. I will talk about how we schedule (cron), run, monitor and report on Airflow at Apigee.

Talk #3: TBD

Schedule:

6:30-7:00 Meet, greet, and eat.

7:00-8:00 Talks

8:00-8:30 Updates on the project, roadmap & upcoming Airbnb sprints, and Q/A for the core project team.

8:30-9:00 Community open mic, step up and make announcements if you're recruiting, looking for help, planning on working on a feature, ...