Andy Leonard - Designing an Execution Framework for Azure Data Factory

Attend “Designing an Execution Framework for Azure Data Factory” and takeaway:

1. Comparison and contrast of Azure Data Factory debug and triggered execution.
2. Benefits and limitations of the Execute Pipeline activity.
3. Benefits and complexity of using the Azure Data Factory REST API for execution.
Experience or familiarity with developing, scheduling, and monitoring Azure Data Factory pipeline executions is suggested.

If your enterprise manages dozens of ADF pipelines, an execution framework is unnecessary overhead. If your enterprise manages thousands of ADF pipelines? You need an execution framework. But how should you implement it? Should you take a straightforward approach and use the Execute Pipeline activity or implement a metadata-driven approach using the Azure Data Factory REST API?

Prerequisites: Experience or familiarity with developing, scheduling, and monitoring Azure Data Factory pipeline executions is suggested.

Goals:
1. Comparison and contrast of Azure Data Factory debug and triggered execution.
2. Benefits and limitations of the Execute Pipeline activity.
3. Benefits and complexity of using the Azure Data Factory REST API for execution.