The 10th Meetup in the history of PostgreSQL User Group NL

Hi all,

We are very happy to invite you all to a Special Edition of the "PostgreSQL User Group NL" meetup, as this is the 10th Meetup in the history of this User Group. For this Special Edition we have a great line-up as well as an inspiring location: the Microsoft HQ at Schiphol!

As usual we offer the opportunity to participate in the Lightning Talks. If you have anything to share on the subject of PostgreSQL, please let us know and we are happy to give you the floor for 3 minutes.

The Meetup will be held at the office of Microsoft. Food and drinks are for free. We are very grateful to Microsoft for their hospitality!!

Let’s meet and shake hands on June 6st.

Coen Hamers (Splendid Data)
Gerard Zuidweg (OptimaData)

*************

Our Agenda:

17:30 - 18:30 Arrive, food and drinks

18:30 - 18:35 Welcome Gerard & Coen

18:35 - 19:05
HYPERSCALE (CITUS) ON AZURE DATABASE FOR POSTGRESQL
By: Marco Slot, Principal Software Engineer at Microsoft

Marco Slot will demonstrate how you can use the new Hyperscale (Citus) feature in Azure Database for PostgreSQL to get fast response times at any scale and show the demo he gave at Microsoft Build.

19:15 – 20:00
PERIODS AND SYSTEM-VERSIONED TABLES
By: Charles (Vik) Fearing. Charles is a full-time PostgreSQL consultant, auditor, and trainer based in Paris, France. He is the organizer of the annual pgDay Paris, and an active member of the worldwide community (mostly on irc).

SQL 2011 introduced the concept of a Period. These can be used for many things but the most well-known application is system versioned tables where all changes to a table are recorded and can be summoned via SQL. PostgreSQL is one of the last databases to implement this feature. In this presentation we will see the many different ways periods can be used, and talk about the current status of their implementation.

20:00 – 20:45
MASSIVELY SCALABLE ETL IN REAL WORLD APPLICATIONS: THE HARD WAY
By: Floris Sluiter. Floris is an independent IT specialist with expertise in Big Data and High-Performance Computing. He likes to be at the crossover boundary between infrastructure and applications. Over the years, he managed, implemented and optimized many large-scale data analytics applications, both on cloud platforms and hard iron. At first, he worked for research institutions, and later he turned to freelancing for commercial large and small companies.

Big Data examples always give the correct answers. However, in the real world, Big Data might be corrupt, contradictory or consist of so many small files it becomes extremely hard to keep track - let alone scale. A solid architecture will help to overcome many of the difficulties.
Floris will talk about a real-world implementation of a massively scalable ETL architecture. Two years ago, at the time of the implementation, Airflow just became part of Apache and still left many features to be desired for. However, requirements from the start were thousands of ETL tasks per day on average, but on occasion, this could become hundreds of thousands. The script-based method that was in place was already not capable to meet the requirements on a day to day basis and needed to be replaced as soon as possible. So this custom framework was rolled out in just 8 weeks of development time.

20:45 – 21:00
Lightning Talks

21.00– 21.30
Wrap up and get together with refreshments