The Prefect ETL - Orchestrating a modern data solution @ Aggreko


Details
At Aggreko, we are building the future of ETL now. We have moved our on-premise BI solution to the cloud. During the migration we found that finding the right way to orchestrate our transformation jobs can be challenging; however, in Prefect, we have found an out-of-the-box solution that fits the needs of our data and most importantly our business perfectly. In this session I will discuss our modern data architecture, how Perfect fits in and how we see it becoming a bigger part of our wider Insights team this year! I will also demo how simple it is to create a Prefect flow in Python, deploy data transformation logic to a Databricks cluster and then run it on Databricks, all from your local terminal.

The Prefect ETL - Orchestrating a modern data solution @ Aggreko