Virtual PyData Denver - April 15!

Hi all!

Laura Lorenz is a developer advocate from Prefect and will be hosting an in-depth walkthrough and tutorial for about two hours over Zoom. I use Prefect at Empiric, and both Prefect Core and Cloud are very useful separately or together! Plus, all of Core and most of Cloud is open-source which makes for great community collaboration and feedback.

Also, I am including an event question to gauge how many people will be following along with the tutorial and how many will simply be watching. We will be recording this, so don't worry if you won't be able to follow along during the event itself.

Prefect is a dataflow automation ecosystem that seeks to make writing data pipelines easy and intuitive for data engineers and data scientists. The backbone of the ecosystem is the open source Python library Prefect Core, which provides a Python API for designing directed acyclic graphs of Python code that emphasize robustness (retries, parallelism, caching, alerting, ad-hoc or scheduling) and intuitiveness (data dependencies, imperative API, secrets management) without sacrificing on flexibility (custom state handlers, custom triggers, custom result handlers).
Data engineers or data scientists who are interested in writing data pipelines with software that has a great developer experience, a fully-featured and easily customizable open source API, and compatibility with a hosted scheduling product (Prefect Cloud) that offers both free and paid levels of managed service should come to this tutorial.
In this tutorial, participants will:

• Download, install, and configure Prefect Core version 0.10.1+, an open source data workflow engine
• Write and execute locally a case study data engineering pipeline for monitoring SSH connections that showcases state and data dependencies between tasks and the passage of data through tasks using Prefect's Flow AP
• Host your own basic orchestration service using Prefect Core server to schedule and monitor workflows, and recognize the managed options available to the free and paid tiers of Prefect Cloud
• Understand the more complex pipelining features of Prefect Core including custom triggers, input and output caching, persisting data with Result Handlers, and custom state handlers