A mix of PostgreSQL, Data Lakes, Debezium and Windows

Hi everyone,

We are very happy to let you know that the MIC in Mons (https://www.mic-belgique.be/a-propo-du-mic) has gently accepted to host our next Meetup on Tuesday 13th of February at 18h00.

Data Egret (https://dataegret.com) will sponsor the event and offer some drinks and pizzas.

The location:
MIC - Avenue des Bassins 64 (1st floor), 7000 Mons.
The place is easily reachable by train (near the Mons train station) or by car (free parking at Lotto Mons Expo).

The agenda:
18:00 Welcome & Food
19:00 "What did I learn running Postgres on Windows" by Ilya Kosmodemiansky (CEO and co-founder of Data Egret)
19:45 "Real-time Feeding of a Data Lake with PostgreSQL and Debezium" by Julien Riou (Tech Lead at OVHcloud)
20:30 Wrap-up & Drinks

More details about the talks:

- What did I learn running Postgres on Windows -
The MS Windows OS family has traditionally been viewed as a suboptimal host system for running Postgres in productive environments. In recent years, an increasing number of users reach out to us for help running Postgres on Windows.
The reasons for this are more intricate than the currently trending exodus from commercial databases. Postgres grew in its popularity, it is feature-reach, supported by popular .NET frameworks and importantly, it is easier to find developers who know Postgres.
In this talk, I will guide you through the various options available in 2024 for running Postgres in production on MS Windows. From "native" installer, WSL and WSL2, containers or VMs, and the usage of DBaaS. I will compare these options from both feature and performance perspectives, diving into the challenges associated with each.
Recognizing that Postgres is not just a database but an ecosystem encompassing numerous extensions, high availability and backup/recovery solutions, we will also explore strategies to fully leverage this ecosystem on Windows.

- Real-time Feeding of a Data Lake with PostgreSQL and Debezium -
Relational database management systems (RDBMS), including PostgreSQL, are among the most critical components of the infrastructure that governs OVHcloud services. The majority of applications rely on OLTP (Online Transaction Processing) workloads, which are frequent but short-lived. However, when data scientists began issuing OLAP (Online Analytical Processing) queries – fewer in number but lengthy and resource-intensive – to generate reports, certain services experienced degradation. In this presentation, you will discover the challenges we faced in implementing real-time replication from our PostgreSQL databases to our Data Lake using Debezium.

See you there