Data Ingestion at Scale

During this session Steven will cover the main features and strategies behind his Data Ingestion Engine. We will discuss the needs/desires of many analytic consumers of data (hint: "now" and "raw"); how schema evolution plays out in a practical sense; the importance of maintaining a data inventory; and how to develop 800 data feeds at once. We will wrap with an overview of a recent implementation of this solution and some of the use cases that the acquired data serves such as machine learning and operational reporting.

About our speaker:
Steven Frobish is a Data and Analytics consultant for Daugherty Business Solutions. He has a 17 year career in Data Warehousing, ETL, and Data Engineering and has spent the past six years focused on the Hadoop ecosystem. A former Informatica expert, Data Integration Architect, and Data Engineer, Steven has been focused on repeatable processes that adjust automatically to data changes and are resilient in the face of unplanned outages.

Agenda
6:30 - 7: 00 Food and Networking
7:00 - 8:00 Presentation
8:00 - 8:15 Questions

Food, room, and speaker are sponsored by Daugherty Business Solutions.