Powering a solution designed for change: an engine for data automation (English)

We’re happy to once again welcome Dutch-Australian data warehouse automation guru Roelant Vos who will give us an update on the latest data engine thinking.

Abstract:

If you agree that data interpretation and modelling takes time to get right, that data and its context changes over time, and that models and even methodologies (should) change over time as well, then you might be interested in a data solution that is designed for a high degree of flexibility.

Such a solution would require several concepts, frameworks and components to work well together, so that the solution is capable of morphing with the changing world at speed and scale.

In this presentation, Roelant will demonstrate how this could work by generating a data solution that adopts the ‘eventual consistency’ pattern. What if you truncate your data warehouse, and it just grows back exactly as it was? How could it work to tweak the model, and see the data adjust to that interpretation?

For many years, Roelant has written about how to build pieces of this puzzle on his blog. Now a book written by him and Dirk Lerner on everything that is required for this, and how to do it, is about launch (visit https://www.dataenginethinking.com/ for more information).

He’s also developing an accelerator (‘data warehouse automation service’), now in open beta, that is meant to assist in implementing these solutions: Agnostic Data Labs (ADL).

It’s time to bring all of this together, make sure that one of Roelant’s favourite concepts – eventual consistency – (as per the book) is generated from the model (using ADL), and that the model changes are automatically applied to the resulting solution.

Speaker:

Having worked as a consultant, trainer, software vendor, and decision maker in the corporate world over the years, Roelant Vos has observed data management from many different points of view.

Throughout his career, the common theme has always been a passion for data automation & code generation, finding and using repeatable patterns to interpret data. Roelant has always felt that this is the key to making data solutions easier, more manageable and truly flexible.

He is currently finalising a book on these topics called ‘Data Engine Thinking’, and has launched a new company ‘Agnostic Data Labs’ that provides tooling to implement data solutions that adopt these ideas.

Agenda:

11:00 Welcome & Introduction
11:05 Powering a solution designed for change: an engine for data automation (Roelant Vos)
11:50 Discussion & Conclusion