Name: Building a realtime cloud data warehouse in 4 simple steps
Start: 2019-02-07T18:00:00Z
End: 2019-02-07T21:00:00Z
Location: DIT Grangegorman

Building a realtime cloud data warehouse in 4 simple steps

Learn how to model, load, and discover insights from a real-time cloud data warehouse in 4 simple steps.

Step 1: Using bike sharing data we will design a data warehouse data model via the Data Vault modeling pattern - the next generation data modelling methodology. This design is agile friendly, supports massively parallel ETL, and by its nature leads to a fast turnaround on requirements. 80% of data warehouses in the Netherlands are implemented using the Data Vault approach.

Step 2: We will deploy the Data Vault data model on Snowflake and build a virtual data mart for reporting and dashboards . Snowflake is a true data warehouse as a service - it was purpose built for the cloud. With its scalability, decoupling of storage & compute, and a pay per use billing model, Snowflake is the #1 cloud data platform.

Step 3: We will stream data from our SQL Server source database into the new Data Vault on Snowflake using Fivetran. Fivetran is a cloud based heterogeneous data pipeline supporting batch processing or streaming, can adjust to source schema changes automatically, and provides a plethora of connectors.

Step 4: We will load the data into the DataChemist Knowledge Graph to find and visualise hidden connections and derive new insights. The DataChemist Knowledge Graph acquires and integrates information and applies a reasoner to infer new knowledge. With DataChemist you can trivially traverse vast datasets and answer the connection oriented questions that matter. DataChemist’s Knowledge Graph perfectly dovetails with the Data Vault data model.

Where:

HQ
GW 107, Greenway Hub
DIT Grangegorman
Dublin 7

Parking:

You can find parking on Lower Grangegorman Road.

What are my transport/parking options for getting to and from the event?

The DIT campus at Grangegorman is located in the heart of Dublin and is just 1km from O’Connell Street. Detailed information on how to get there can be viewed http://www.dit.ie/campuslife/transport/

You can find parking on Lower Grangegorman Road.

Kristijan Berta

Data Engineering and Data Architecture Group (DEDAG)

Technology

Data Architecture

Data Engineering

Data Integration

Master Data Management

Python

Data Science

Cloud Computing

Data Analytics

Data Quality

Data Management

Business Intelligence

Data Visualization

Building a realtime cloud data warehouse in 4 simple steps

DIT Grangegorman

Share

This event was canceled

Data Engineering and Data Architecture Group (DEDAG)

Building a realtime cloud data warehouse in 4 simple steps

Data Engineering and Data Architecture Group (DEDAG)

Details

Members are also interested in