Building a high-performance database in Java is impossible!

Speaker: Jaromír Hamala (@jerrinot, QuestDB)

Abstract:

Or is it not? We built QuestDB, an open-source high-performance database, primarily in Java. What do I mean by 'high-performance' anyway? A single machine running QuestDB can ingest millions of rows per second and query billions. There is no magic here, just a lot of hard work and clever engineering. We focused on efficient data structures, parallel execution pipelines, and mechanical sympathy. Our Java is somewhat unorthodox: We aim for zero steady-state allocation, and we are not hesitant to jump to native code when needed.

In this session, I'll take you to the sausage factory and show you some of the techniques we use, including:

- SIMD-based optimizations from Java and native code for maximum throughput. We even build our own Just In Time (JIT) compiler!

- Implementing parallel execution pipelines to use multi-core processors effectively. - Our approach to off-heap memory management to achieve near-zero GC pauses.

- Crafting specialized data structures and algorithms suitable for high-performance Java.

I'll also answer the most common question people ask when they learn about our unorthodox Java: Why the heck do you use Java at all?!

--
We will also stream this time online at https://youtube.com/live/SOW2YGab2zA! If you plan to attend online, you don't need to register here since we're using this information to order food. This is also a tiny push for you to come in person!

See you there!