Vancouver Airflow Meetup at Amazon!
Details
Join Airflow experts from Astronomer and AWS for an evening of talks, networking, and delicious food and drinks at Amazon's Offices!
PRESENTATIONS
Talk #1: Native AI Orchestration in Airflow: A Deep Dive into the Common AI Provider
- Speaker: Kenten Danas, Developer Relations Manager, Astronomer
More and more data engineers are being tasked with productionizing AI workflows. As the de facto standard for data orchestration, Airflow is rising to the occasion. The newly released Common AI provider gives Airflow native operators and decorators for AI tasks and agents, with support for any major model and toolsets that expose the 350+ existing Airflow hooks as agent-callable tools. This talk will cover everything you need to know about what's in the new provider and how to use it in your Dags.
Talk #2 Built for Scale: Airflow's Native Multi-Team Architecture
- Speaker: Ramit Kataria, Amazon
As Airflow deployments scale, organizations increasingly need to support multiple teams with different requirements on a shared platform. Rather than strict multi-tenancy with complete isolation, Airflow's new multi-team architecture provides flexible, native support for isolated task execution, UI experiences, and secrets management, all while sharing a single scheduler, API server, and database. This talk will cover how we designed the architecture working backwards from real community pain points and the key technical details.
AGENDA
- 5:00 PM-5:30 PM: Arrivals, Eat, Drink and Network
- 5:30 PM-7:30 PM: Presentations
- 7:30 PM- 8:00 PM: Eat more, drink more, and network
