Scalable, Large-Volume Data Synchronization in OLTP Systems
Synchronizing data from any external source (file, web form, web service, etc.) poses problems as the data volume and/or transaction count increases. While a data warehouse might have a regular window in which to ETL its data, an OLTP system--especially one that serves a 24 / 7 / 365 business--has to deal with issues such as concurrency, disk space, and even memory management on the app server. And the processing still needs to be done ASAP. Solomon Rutzky will show various methods that he has used to synchronize tens of thousands and up to millions of rows quickly, with very little app-memory used, and all while performing validations and transformations.
Solomon Rutzky has been working with computers for almost 30 years, across several different platforms, languages, and roles. He has been working with databases for 17 years now and has focused on Microsoft SQL Server for the past 11 years. He specializes in development, data modeling, and performance tuning and doesn't much care for the administrative side of things. Solomon has written articles for SQLServerCentral.com and Simple-Talk.com, and is also the author of SQL# -- the popular SQLCLR library of functions that greatly expands what can be done in T-SQL (http://www.SQLsharp.com/). In his spare time, he enjoys...wait, with three kids under the age of 4, he has no spare time :(.
6:30PM - 6:45PM - Meet, Greet and Eat - Thank you to our sponsor TEK Systems
6:45PM - 6:50PM - Meeting Announcements
6:50PM - 8:15PM - Presentation
8:15PM - 8:30PM - Q & A and Wrapup