OPTIMIZING ETL on SQL Server side

When you try to optimize Power BI, the first advice you get is to push the data processing as far upstream as possible.
Query folding in Power Query tries to enforce this logic as much as possible. But what is going on SQL Server side? What if the daily extract – transform - load (ETL) process is too slow?
The real optimization of the ETL process starts with finding what has changed on the source, finding the delta. In SQL Server, you have many methods for this. You can use the Change Tracking (CT), Change Data Capture (CDC), system-versioned tables, ROWVERSION data type, triggers…
Which method might be the fastest? In the next step, how do you optimize staging tables? Do you use regular tables, temporary tables, memory-optimized tables? Can you leverage minimally logged operations? Does it make sense to pre-aggregate the data? Disable indexes and constraints or not? What about table partitioning?

This presentation will help you answer these questions and help to find the most suitable solution for you.

Parts:
· Finding the delta
· Optimizing staging tables
· Disabling indexes and constraints
· Table partitioning

About the speaker: Dejan Sarka, MCT and SQL Server MVP, is an independent trainer and consultant that focuses on development of database & business intelligence applications.
Besides projects, he spends about half of the time on training and mentoring. He is the founder of the Slovenian SQL Server and .NET Users Group.
Dejan Sarka is the main author or co-author of 20 books about databases and SQL Server. Dejan Sarka also developed many courses and seminars for Microsoft, SolidQ and Pluralsight.

Join us!
15.05.2024 (17:00 EET)
Language: ENGLISH
Contact us: +359 885 113 442 | office@inspirit.bg | vili.koleva@inspirit.bg