Berlin Open Source Data Infrastructure Meetup - July 2023

Are you interested in learning more about open-source data technologies? Do you want to network with other like-minded people in a fun, relaxed environment?

Then come join us on Thursday, July, at the Aiven office in Berlin for an evening filled with great opportunities for networking and special technical talks. Read below for more details!

Before and after the talks, we’ll have food* and some time for socializing.

Note: The event starts at 6:00 PM CEST and runs until 9 PM CEST.

Program:
6.15PM - Open Doors
6.30 PM - Welcome
6.40 PM - 7.00 PM - Food & refreshments
7.00 PM - Introduction to TiDB - a distributed SQL database

Introduction to TiDB - a distributed SQL database. We will go through its architecture and how it distributes data and provides high availability. Besides its row-based storage for efficient transaction handling, it also provides optional column storage for speeding up analytics queries.

About the speaker: Mattias Jonsson - Senior Database Engineer at PingCAP. He has worked with MySQL for more than 15 years. Prior to joining PingCAP, he worked for Booking.com, where he spent a significant amount of time on MySQL.

7.30 PM - Beginners guide to balance your data across Apache Kafka partitions

Apache Kafka is a distributed system. At the heart of Apache Kafka is a set of brokers that contain topics. Topics are split into partitions. Dividing topics into smaller pieces allows us to work with data in parallel and achieve higher data throughput.

Such parallelization is the key to a performant cluster, however it comes with a price. First, reading from multiple partitions will eventually mess up the order of records, meaning that the resulting order will be different from when the data was pushed into the cluster. Another big challenge is uneven distribution of data across partitions.

Overloaded partitions present a dangerous issue for performance of all involved parties, but especially for brokers and consumers. Therefore, when building our product architecture we should carefully weigh up how many partitions we need, how to ensure proper message ordering, how to balance records across partitions, not forgetting about data load distribution over time. And do all of this while still maintaining good performance of the cluster.

If you're fresh to Apache Kafka, or looking for good practices to design your partitions and avoid common pitfalls, you'll find this session useful!

About the speaker: Olena is a Sr. Developer Advocate at Aiven. With a background in software engineering, she's led teams and developed mission-critical applications at Nokia, HERE Technologies, and AWS. Currently, she works at Aiven where she supports developers and customers in using open-source data technologies such as Apache Kafka, ClickHouse, and OpenSearch. She is also an international public speaker and regularly present at conferences around the world. She holds AWS Developer and Solutions Architect certifications, and is also a Confluent Catalyst.

8 PM - 9 PM - More food & Socialising

*Please note that this is an alcohol-free event.

Catering
Pizza (vegan, vegetarian, and gluten free options will be available), soft drinks & water.