Triangle SQL Server User Group

 
 
 

Abstract
Both Azure Data Factory and Azure Synapse Analytics support the use of data integration pipelines. Within this data integration framework, there are many ways a business problem can be solved. How do you pick the best solution for your client?

The talk will start with reviewing three ways to solve data integration problems: traditional pipelines, mapping data flows and wrangling data flows. It is my opinion that traditional pipelines allow the developer to write a flexible meta data driven ELT framework.

Data might exist on premise or in the cloud. Therefore, it is important to know how to set up and configure a self hosted-integration virtual machine for a hybrid cloud design.

The talk with finish with a comparison between hard coded and dynamic pipelines. The former is only good for a specific business use case and will cause a maintenance night mare over time. The later may uses parameters at the linked service, dataset and pipeline levels to promote re-use of the objects.

At the end of this talk, the developer will be very knowledgeable at the different ways to solve business problems with data integration pipelines.

Bio
John Miner is a Senior Data Architect at Insight Digital Innovation helping corporations solve their business needs with various data platform solutions.

He has over thirty years of data processing experience, and his architecture expertise encompasses all phases of the software project life cycle, including design, development, implementation, and maintenance of systems.

His credentials include undergraduate and graduate degrees in Computer Science from the University of Rhode Island. Also, he has earned certificates from Microsoft for Database Administration (MCDBA), System Administration (MCSA), Data Management & Analytics (MCSE) and Data Science (MPP).

John has been recognized with the Microsoft MVP award six times for his outstanding contributions to the Data Platform community.

When he is not busy talking to local user groups or writing blog entries on new technology, he spends time with his wife and daughter enjoying outdoor activities. Some of John’s hobbies include wood working projects, crafting a good beer and playing a game of chess.

 
 
 

Description
Platform as a service (PaaS)
What is Azure SQL?
Azure SQL Database (PaaS)
vCore and DTU purchasing models
vCore model and service tiers options
Service tier characteristics SQL Azure
Hyperscale service tier
What is a Hyperscale database?
Hyperscale service tier architecture
Hyperscale service tier capabilities
Hyperscale service tier limitations
Demo
Q&A

Bio
Data specialist with more than 15 years of hands-on experience in database administration and optimisation.

Also, Certified Microsoft Trainer (MCT) and Microsoft Certified Solutions Expert (MCSE) with a Master‘s degree in Information Technology.
Sharing knowledge and contributing to the SQL Server community is my passion.

I am also an organiser of the Auckland SQL User Meetup Group. As well I am active blogger and speaker at different SQL events such as SQL Saturdays, Meetups etc.