Let's Talk Data Integration and ETLs
Details
Agenda
• 10:00-10:15 - Opening, Announcements, and More...
• 10:15-11:15 - Let's Talk Data Integration and ETLs
• 11:15-11:30 - Q&A
Session: Let's Talk Data Integration and ETLs – Yossi Drori (60 Minutes, Hebrew)
Data integration/ETL processes are a critical part of any application that moves data between 2 (or more) platforms. It can be a migration from a legacy system to a new one (cloud?) or an on-going process that is part of the system architecture. Some of those processes can get really complex, especially when we are talking about a BI/DWH project.
In this session, Yossi will review this old but still relevant (maybe more than ever) process, in-order to describe the different concepts, complexity and some of the possibilities.
• Terminology and basics
• Different concepts
• 3rd-Party Tools vs Coding
• Explain the complexity – "It is just copying data from one place to another" – is it?
• Some more considerations regarding the process: timing, SCD, CDC, GIGO...
• Demo using PDI ("Pentaho Data Integration")
