Scaling up Postgresql User Group NL

Session 1: Scaling up PostgreSQL

Speaker: Andres is a PostgreSQL committer and developer, focusing on replication, scalability and robustness. Before Citus Data he worked as a PostgreSQL Developer and Consultant at 2ndQuadrant and as a freelancing consultant in the areas of databases and software engineering. He has been developing Postgres and other Open Source projects since 2005. In his free time he enjoys climbing, diving and reading paper books.

Description: Postgres has for a long time been lauded to handle concurrency well, being able to process more requests if additional resources (CPUs) are added. Unfortunately, after that had been determined many years ago, for a while not much further work had been put into the topic. But since then the number of cores and the general architecture of parallel systems have changed leading to a number of scalability problems. In the last few years a number of people worked hard on fixing these.
I'll talk about some of the major recent scalability improvements (9.2, 9.5, 9.6) that have improved postgres' scalability massively and what the biggest remaining scalability concerns are. Some of the remaining issues can mainly be addressed by changing Postgres, others can be worked around on the application side.

Session 2: Shard and scale out PostgreSQL using pg_shard

Speaker: Marco Slot is a software engineer at Citus Data where he works on CitusDB, a solution for parallelizing analytical queries on sharded PostgreSQL tables. Previously he worked as a software engineer on Amazon CloudFront and Route 53 for several years, and has an MSc in Parallel and Distributed Computer Systems from VU University Amsterdam and a PhD on cooperative self-driving cars from Trinity College Dublin.

Description: The open source pg_shard extension for PostgreSQL lets you seamlessly distribute a table across many servers for horizontal scale and replicate it for high availability. The extension transparently distributes your SQL statements without requiring any changes to your application. This talk will discuss the logical sharding architecture of pg_shard and how to use it for building a scalable document store in PostgreSQL. We will also give a demo of a masterless pg_shard cluster that can scale to very high insert rates.

Session 3: SD-Pg_insight: a performance analysis tool.

Speaker: Reiner Peterke, responsible for the PostgresPURE development at Splendid Data.

Description: Pg_insight is a flexible tool for collecting historical statistics information using the Postgres statistics infrastructure. It allows for configurable collections. You decided which statistics to collect. Allows for user defined collectors. Can send data to elastic search for graphical representation of the data from performance monitoring and trending.