Name: Working with Azure Data Factory & Creating Custom Activities
Start: 2017-11-29T18:00:00Z
End: 2017-11-29T21:00:00Z
Location: Runway East

*** PLEASE ENSURE THAT IF YOU ARE UNABLE TO ATTEND, YOU CANCEL YOUR SPACE AND FREE IT UP FOR SOMEONE ELSE ***

In this session, we’ll go beyond the Azure Data Factory copy activity normally presented using the limited portal wizard. Extract and load are never the hard parts of the pipeline. It is the ability to transform, manipulate and clean data that normally requires more effort. Sadly, this task doesn’t come so naturally to Azure Data Factory as an orchestration tool so we need to rely on its custom activities to break out the C# or VB to perform such tasks. Using Visual Studio, we’ll look at how to do exactly that and see what’s involved in Azure to utilise this pipeline extensibility feature. What handles the compute for the compiled .Net code and how can does this get deployed by ADF. With real world use cases, we’ll learn how to fight back against those poorly formed CSV files and what we could to if Excel files are our only data source. Plus, lots of useful tips and tricks along the way when working with this emerging technology.

Bio: Paul Andrew is a Microsoft Data Platform MVP with 10+ years’ experience working with the complete on premises SQL Server stack in a variety of roles and industries. Now as the Business Intelligence Consultant at Purple Frog Systems has turned his keyboard to big data solutions in the Microsoft cloud. Specialising in Azure Data Lake Analytics, Azure Data Factory, Azure Stream Analytics, Event Hubs and IoT. Paul is also a STEM Ambassador for the networking education in schools’ programme, PASS chapter leader for the Microsoft Data Platform Group – Birmingham, SQL Bits, SQL Relay, SQL Saturday speaker and helper. Currently the Stack Overflow top user for Azure Data Factory. As well as very active member of the technical community.

Twitter: https://twitter.com/mrpaulandrew

LinkedIn: https://www.linkedin.com/in/mrpaulandrew/

Blog: https://www.purplefrogsystems.com/paul/

Richard Conway

UK Azure User Group

Technology

Microsoft Azure

Cloud Computing

PaaS (Platform as a Service)

SaaS (Software as a Service)

Internet Startups

Enterprise Architecture

High Performance Computing

Working with Azure Data Factory & Creating Custom Activities

Runway East

Share

UK Azure User Group

Working with Azure Data Factory & Creating Custom Activities

UK Azure User Group

Details

Members are also interested in