- PostgreSQL the Hardway & PostgreSQL 12: what is in the kitchen?
Hi all, We are proud to present to you the first "PostgreSQL User Group NL" meeting of 2019 with a great line-up! The PostgreSQL User Group NL intends to contribute to the promotion of the Open Source Relational Database PostgreSQL. We do this by organizing recurring meetings where we present and discuss technical PostgreSQL related content. This way we want to keep the sessions interesting for a large audience and especially technicians. Once again, we have found a number of interesting topics to increase your PostgreSQL knowledge while enjoying a drink. We look forward seeing you there. Also in this meetup we offer the opportunity to participate in the Lightning Talks. If you have anything to share on the subject of PostgreSQL, please let us know and we are happy to give you the floor for 3 minutes. This Meetup will be held at the office of Adyen. Food and drinks are for free. Many thanks to Adyen for their hospitality!! Let’s meet and shake hands on March 14th. Coen Hamers (Splendid Data) Gerard Zuidweg (OptimaData) Feike Steenbergen (Adyen) ************* Our Agenda: 17:30 - 18:30 Arrive, food and drinks 18:30 - 18:35 Welcome Gerard & Coen 18:35 - 19:20 POSTGRES THE HARDWAY By: Dave Pitts - Technical Manager, Global DBA Operations, Cloud Services at Blackboard Dave will demo some key edge cases (where you don't want to be) using easy to build examples on top of pgbench and simple "vagrant up" installs (scripts all on github). Dave will also be demoing a few cool new features in pg10 and pg11 using pgbench & vagrant again. 19:30 – 20:15 POSTGRESQL: WHAT IS IN THE KITCHEN? By: Devrim Gündüz - long-time PostgreSQL, Red Hat, Fedora contributor, and also working on some more open source projects. He is responsible for the PostgreSQL YUM and ZYPP repositories for RPM based distributions PostgreSQL 12 is underway and next to that there are some tentative item in the roadmap as well. In this talk, I will mention about the upcoming features in PostgreSQL 12 and I will also share information about the features that are either WIP or in the plan. 20:15 – 20:30 Lightning Talks 20.30– 21.00 Wrap up and get together with refreshments
- PostgreSQL Landscape of Bol.com & Real-time Analytics at Any Scale
Hi all, Proud to introduce you the last "PostgreSQL User Group NL" meeting of 2018. Once again, we have found a number of interesting topics to increase your PostgreSQL knowledge while enjoying a drink. Do not miss this! Because of the success we had the previous time, we will continue our “lightning talks”. A lightning talk is a very short presentation lasting only a few minutes. Everybody has the opportunity to take the stage for a few minutes and talk about a particular subject that he/she wants to share or even want some input on from the group. You can reserve your slot for a lightning talk by sending us a mail or write your name down on the day of the Meetup itself. This Meetup will be held at the office of Bol.com. Food and drinks are for free. Thanks to Bol.com for their hospitality. Let’s meet and shake hands! Coen Hamers ( Splendid Data) Gerard Zuidweg (OptimaData) Feike Steenbergen (Adyen) ************* Our Agenda: 17:30 - 18:30 Arrive, food and drinks 18:30 - 18:35 Welcome Gerard & Coen 18:35 - 19:20 HOSTING POSTGRESQL DATABASE IN THE CLOUD By: Jing Rao - Database Engineer Bol.com At Bol.com the whole IT landscape is moving towards cloud. To be able to provide PostgreSQL database for applications running in the cloud, and at the same time customize the database setup according to IT security and business requirements that we have at Bol.com, we started a project to create our home-made solution of hosting PostgreSQL database in the cloud. This solution is build based on Google Kubernetes Engine. We have combined 2 open source project "Crunchydata" and "Pghoard" with our own automation to provide PostgreSQL database as service for the development teams. In this talk I would like to share information and our experience on this project.” 19:30 – 20:15 REAL-TIME ANALITYCS ON POSTGRESQL AT ANY SCALE By: Marco Slot - Software Imagineer Citus Data Building a dashboard that provides real-time insights into a large data stream is a challenging problem. The database needs to support high ingest rates, handle low latency (subsecond) analytical queries from many concurrent users, and reflect new data as soon as possible, while keeping data over long periods. This talk will discuss how you can build a scalable real-time analytics pipeline using PostgreSQL with extensions such as HLL and pg_partman, and how you can scale out across many servers using Citus. 20:15 – 20:30 Lightning Talks 20.30– 21.00 Wrap up and get together with refreshments
- Backup and Replicate
Hi all, Yes, we are ready for a new "PostgreSQL User Group NL" meeting. Once again, we have found a number of interesting topics to increase your PostgreSQL knowledge while enjoying a drink. Do not miss this! Furthermore we introduce a new item to the program of this Meetup: the lightning talk. A lightning talk is a very short presentation lasting only a few minutes. Everybody has the opportunity to take the stage for a few minutes and talk about a particular subject that he/she wants to share or even want some input on from the group. You can reserve your slot for a lightning talk by sending us a mail or write your name down on the day of the Meetup itself. This Meetup will be held at the office of KPN Digital. Food and drinks are for free. Thanks to KPN Digital for their hospitality. Let’s meet and shake hands! Coen Hamers ( Splendid Data) Gerard Zuidweg (OptimaData) Feike Steenbergen (Adyen) ************* Our Agenda: 18:00 - 18:30 Arrive, food and drinks 18:30 - 18:35 Welcome Gerard & Coen 18:35 - 18:50 Introduction PostgreSQL @ KPN 18:50 – 19:25 HOW IS YOUR BACKUP DOING? By: Marc Angenent - Delivery Manager Splendid Data During this session Marc will highlight the importance of having a backup and restore strategy and some PostgreSQL backup possibilities, scenarios and some PostgreSQL backup solutions. What are the possibilities, what is the best solution for my situation and how do I ensure that I achieve my RPO and RTO. 19:30 – 20:15 EVERYTHING YOU WANTED TO KNOW ABOUT REPLICATION BUT WERE AFRAID TO ASK By: Boris Mejías - PostgreSQL Consultant and Trainer Having a replicated environment is very common nowadays. So common that PostgreSQL configuration settings for replication are active by default. But when it's so common, people starts to forget how it works and what to do when the system start presenting failures. In this talk we will review the main concepts behind streaming replication, how to monitor it, how some settings affect it, what to do in case of failure and some interesting tips and tricks. We will also explore the differences with logical replication, and what are the advantages, challenges and risks of multi-master architecture. 20:15 – 20:30 NEW: Lightning Talks 20.30– 21.00 Wrap up and get together with refreshments
- MIGRATION APPROACHES AND TOOLS & ANALYZING DATABASE PERFORMANCE
Hi all, We are really pleased to announce a new meeting of our "PostgreSQL User Group NL"! Spread the word and let’s meet. Again, it will be a wonderful evening you simply cannot miss to gain PostgreSQL knowledge. This time the Meetup will be held at the office of Bol.com . Food and drinks are for free. Thanks to Bol.com for their hospitality. Let’s meet and shake hands! Coen Hamers ( Splendid Data) & Gerard Zuidweg (OptimaData) ************* Our Agenda: 18:00 - 18:45 Arrive, food and drinks 18:45 - 19:00 Welcome (Coen Hamers and Bol.com) 19:00 – 19:45 AN OVERVIEW OF TODAY’S ORACLE > POSTGRESQL MIGRATION APPROACHES AND TOOLS. By: Coen Hamers - Splendid Data We do not need to explain to the members of this group what the strengths are of PostgreSQL when it comes stability, data integrity etc. More and more organizations are also becoming aware of these strengths and therefore increasingly the use of PostgreSQL as an alternative to Oracle. The desire of these organizations ensures the creation of multiple tools that help in the migration process. Currently, different migration methods and tools are offered by different PostgreSQL affiliates. In this presentation we show an overview of the various approaches that are currently on the market. We will present an overview about the possibilities and impossibilities of the various tools and, based on our practical experience, what the various bottlenecks and pitfalls are. We also briefly explain the primary reasons for organizations to migrate. Core phrases of this presentation are: • Why migrate from Oracle to PostgreSQL? • Migration of DB schema (database data objects). • Migration of procedures (database code objects). • Practical examples of data conversion. 19:45 – 20.30 ANALYZING DATABASE PERFORMANCE By: Feike Steenbergen - Adyen Database Performance will at some point become important for almost every database, whether you require faster response times for your users, or your database instance is sometimes fully utilized, you will need to investigate and resolve the issue. Performance tuning your queries is one of the best ways of increasing the speed of your database, with better performance you may even run your databases on smaller (cloud) instances. PostgreSQL itself provides a lot of out-of-the-box tools to aid you in analyzing your performance. This session covers the following topics: • logging and analyzing slow queries using the diagnostic logs • using the pg_stat_statements extension to track queries • use EXPLAIN and EXPLAIN ANALYZE to understand the query plan for a query • how the PostgreSQL planner uses statistics to determine the optimal query plan • use the statistics collector views to identify common patterns (e.g. missing index) All of these topics will be accompanied with examples using the psql terminal to show that even though additional tools (profiling, graphing) provide a lot of value, you do not need those tools to get started with performance improvements. Feike is working for Adyen as a PostgreSQL Database engineer. Previously he has worked at Zalando, where he was part of the team that designed and built Patroni. He has been training people in PostgreSQL for the last 10 years. 20.30– 21.00 Wrap up and get together with refreshments
- "What's new PostgreSQL 10" & "Usercase Adyen"
Hi all, Time for a new gathering of the "PostgreSQL User Group NL"! Again we have been able to find great speakers with exiting PostgreSQL subjects. It will be a wonderful evening you simply cannot miss. Food and drinks are for free, thanks to KPN. We really would like to increase the membership of our group, and the number of visitors at our event. If you know others interested in joining our meeting, please ask them to attend this event! Why? We want to spread the PostgreSQL word all over NL! You are warmly welcome! Coen Hamers. ------- Session 1: What's new PostgreSQL 10 - "A Look At The Elephants Trunk" Speaker: Magnus Hagander Magnus Hagander is a member of the PostgreSQL Core Team and a developer and code committer in the PostgreSQL Global Development Group. Subject: The upcoming version of PostgreSQL will be 10, and by now we are well past feature freeze and there are only bug fixes remaining before the release is ready. This talk will take a look at some of the things that are available in what will eventually become PostgreSQL 10. Session 2: PostgreSQL usercase Adyen - "Managing one of the biggest PostgreSQL databases" Adyen is a global multichannel payment company offering businesses an outsourced payment solution, which enables merchants to accept payments from anywhere in the world and provides a global payment solution for mid, large and enterprise e-commerce merchants. Adyen serves over 3,500 customers globally. The service is used by international and multinationals companies including, Uber, Facebook, Evernote, Etsy, Nike, Spotify, Airbnb, Mango, Vodafone, Booking.com, KLM, Greenpeace, SoundCloud, Superdry and Groupon. Subject: "Adyen hosts one of the largest PostgreSQL instances in the world. This presents interesting technical challenges, which our team loves working on. However this also presents a business risk, as we expect our database not to scale to the 100x we are building for. For this reason we’ve decided to change our processing architecture to a streaming framework built on top of PostgreSQL. After an introduction, we hope to discuss the interesting details during a Q & A session with our lead architect." Location of the Meetup: KPN Building, Teleportboulevard 121, 1043 EJ Amsterdam, Netherlands (Next across Railway station: Amsterdam Sloterdijk) Thank you KPN Digital for providing us the conference room including drinks and food. Thank you Adyen, for making this meetup possible.
- Usercase Zalando & Tips and tricks for PostgreSQL DBA's and developers
Hi All! Time for a new gathering of our Meetup group! This time we will be meeting in a different place. Thanks IBM for all the previous hosting’s of our Meetup, and thank you KPN for providing us the new conference room including drinks and food. Session 1: Usercase: Zalando Speaker: Feike Steenbergen Feike has been part of the Database Engineering team of Zalando for close to 2 years now. He has worked with PostgreSQL since 2006 and Feike has been a database professional (Oracle and PostgreSQL) since 2008. Description by Feike Steenbergen: “Within Zalando our primary datastore is PostgreSQL. This includes customer, financial and logistics processing information. Within our team we have gathered a lot of PostgreSQL expertise to enable our developers to be able to build and deploy applications quickly and safely. Zalando introduced Radical Agility in 2015, this means that more developers will be operating their own PostgreSQL cluster. Because of this we have built a High Available PostgreSQL that enables developers to operate their databases themselves, or to have them quickly spin up a Database as a Service that will be operated by the Database Engineering Team. I will be speaking about our experiences with PostgreSQL, which tooling we use for monitoring and troubleshooting and how we deploy database changes without disruptions on live systems.” Session 2: “A look at a few Postgres admin tips for added security and my favorite developer features.” by Reiner Peterke Speaker: Reiner Peterke, responsible for the PostgresPURE development at Splendid Data. Description: This time, Reiner will show some very handy PostgreSQL tips and tricks. When you are a developer working with PostgreSQL or you are a DBA wanting to learn for example PostgreSQL security tricks, come offer and follow this session. Reiner will create a lot of “aha!” in this session. Location: KPN Building, Teleportboulevard 121, 1043 EJ Amsterdam, Netherlands (Next across Railway station: Amsterdam Sloterdijk)
- Recipes for PostgreSQL
Session 1: PostgreSQL Administration Recipes Speaker: Gianni is active in the PostgreSQL community, as a board member of the Italian PostgreSQL User Group (ITPUG), and an organiser of various editions of the Italian PGDay as well as of the first European PGDay in Prato, Italy (2009). He is a PostgreSQL and PostGIS consultant at 2ndQuadrant, as a developer, consultant and trainer, and has been speaking at PostgreSQL conferences in several European countries and in USA. Before that he worked at the University of Florence as a researcher in Mathematics. He is an author of the PostgreSQL 9 Administration Cookbook, second edition, from Packt Publishing (Birmingham, 2015). Description: In this talk we demonstrate some techniques that a PostgreSQL DBA can use to solve recurring problems, in the simple format of a cooking recipe. We will consider problems such as: changing your password securely, i.e. without leaving traces of the new password around; quickly estimating the number of rows in a table, sensibly balancing speed vs accuracy; checking which parameters have a non-default setting, so you will avoid surprises when replaying that administration script; carefully removing unwanted indexes, because it is much easier to destroy than to rebuild. Session 2: SD-Pg_insight: a performance analysis tool. Speaker: Reiner Peterke, responsible for the PostgresPURE development at Splendid Data. Description: One of the best methods to maintain your PosgreSQL database, is to take a look at the behavior of the PostgreSQL database in the past. Splendid Data is working on an Open Source project called pgInsight (it is still a work name). pgInsight collects statistics history for performance monitoring. It is a flexible tool for collecting applicable data from the postgres stat and statio views. This information is vital to be able to check the health of your database. We want to introduce and share this Open Source project with you.
- Scaling up Postgresql User Group NL
Session 1: Scaling up PostgreSQL Speaker: Andres is a PostgreSQL committer and developer, focusing on replication, scalability and robustness. Before Citus Data he worked as a PostgreSQL Developer and Consultant at 2ndQuadrant and as a freelancing consultant in the areas of databases and software engineering. He has been developing Postgres and other Open Source projects since 2005. In his free time he enjoys climbing, diving and reading paper books. Description: Postgres has for a long time been lauded to handle concurrency well, being able to process more requests if additional resources (CPUs) are added. Unfortunately, after that had been determined many years ago, for a while not much further work had been put into the topic. But since then the number of cores and the general architecture of parallel systems have changed leading to a number of scalability problems. In the last few years a number of people worked hard on fixing these. I'll talk about some of the major recent scalability improvements (9.2, 9.5, 9.6) that have improved postgres' scalability massively and what the biggest remaining scalability concerns are. Some of the remaining issues can mainly be addressed by changing Postgres, others can be worked around on the application side. Session 2: Shard and scale out PostgreSQL using pg_shard Speaker: Marco Slot is a software engineer at Citus Data where he works on CitusDB, a solution for parallelizing analytical queries on sharded PostgreSQL tables. Previously he worked as a software engineer on Amazon CloudFront and Route 53 for several years, and has an MSc in Parallel and Distributed Computer Systems from VU University Amsterdam and a PhD on cooperative self-driving cars from Trinity College Dublin. Description: The open source pg_shard extension for PostgreSQL lets you seamlessly distribute a table across many servers for horizontal scale and replicate it for high availability. The extension transparently distributes your SQL statements without requiring any changes to your application. This talk will discuss the logical sharding architecture of pg_shard and how to use it for building a scalable document store in PostgreSQL. We will also give a demo of a masterless pg_shard cluster that can scale to very high insert rates. Session 3: SD-Pg_insight: a performance analysis tool. Speaker: Reiner Peterke, responsible for the PostgresPURE development at Splendid Data. Description: Pg_insight is a flexible tool for collecting historical statistics information using the Postgres statistics infrastructure. It allows for configurable collections. You decided which statistics to collect. Allows for user defined collectors. Can send data to elastic search for graphical representation of the data from performance monitoring and trending.
- Kickoff meeting you simply can't miss!
Session 1: What’s new in PostgreSQL 9.5? “A look at the Elephants trunk” Speaker: Magnus Hagander is a member of the PostgreSQL Core Team and a developer and code committer in the PostgreSQL Global Development Group. Description: PostgreSQL 9.5 is almost done - just some final polish and lots and lots of testing left! Most things going into this version are known at this time - this talk will give an overview of some of the things that will be included in the upcoming version! Session 2: If you keep on thinking “Oracle” once you start using PostgreSQL, you will miss the benefits! Speaker: Reiner Peterke, responsible for the PostgresPURE development at Splendid Data. Description: Reiner is doing a high level comparison of Oracle and Postgres. Starting with finding common ground between the two system. Then looking at a few key differences. Finishing with a closer look at the Postgres 'default permissions' feature. Session 3: Deep dive PostgreSQL speed tuning. Speaker: Jan Marten Spit, specialized and experienced in performance optimization, troubleshooting and solutions. Also trainer of the “Postgres DBA advanced courses” of Splendid Data @ Global Knowledge. Description: Jan Marten will talk about how to get the best performance out of your PostgreSQL installation on Linux. Learn everything about memory blocks, disk spins and all kind of buffers. Thanks to SUSE for hosting the meeting!!