Next Meetup

Data Pipelines with Airflow
VENUE: Please note the Venue and Date (3rd Wednesday) for this meetup. For this month's meetup, Matthew Housley will talk about Airflow (https://github.com/apache/incubator-airflow), a platform to programmatically author, schedule, and monitor workflows. As a data engineer, you have probably encountered the following problems: 1) Scheduling and managing jobs in a data pipeline is hard. Cron jobs are unreliable and can quickly become unwieldy. Scripting complex workflows creates maintenance headaches and operational problems. (How do you handle task failures?) 2) Modern data environments are heterogeneous, spanning transactional databases, EDW systems, big data clusters, resources on-prem and in the cloud, APIs, FTP drops, etc. Coordinating these systems requires substantial bespoke plumbing code and dev resources. In this talk, we'll discuss how Airflow helps us to solve these problems and foster a productive data culture. We will see Airflow in action and, barring a live coding disaster, do some basic DAG development. Matthew is a recovering data scientist, current data engineer and the co-founder of Ternary Data. Python, Pizza/or one of Dirk's creations, & Great Prizes! Oh My! Note: anyone needing transportation, please post here. Please message me (Dr. L. Chebib) directly if you wish to present or with any comments or input. A $3 donation at the door is requested (to help with costs), but not required. Notes/Etherpad (https://public.etherpad-mozilla.org/p/Python-Utah-North16Jan2019)

Majestic Mountain Sage

2490 South 1350 West · Nibley , UT

    Past Meetups (43)

    What we're about

    Calling all Pythonistas in the Northern Utah/Southern Idaho area. This is a group for those interested in software development using the Python programming language. We will meet monthly in Logan to discuss aspects and capabilities of the language, as well as explore mechanisms for implementing these features in day-to-day code. We'll explore why Python is a great choice for web infrastructures, application infrastructures, as well as scientific data analysis. Avid and aspiring developers alike are welcome to join.

    Members (152)

    Photos (11)