Past Meetup

How to Write a Database / Avi Kivity, CTO & Co-Founder, ScyllaDB

This Meetup is past

224 people went

Location image of event venue

Details

Join AppsFlyer Engineering for one of the most requested sessions from DevOps Days Tel Aviv!

Avi Kivity, father of KVM, and now ScyllaDB will (FINALLY!) be gracing us with the talk that didn't pan out at DevOps Days: "How to Write a Database" - you won't want to miss this talk from one of the only people in our community who can give it!

Agenda:
18:00 - Mingling, Pizzas & Beers
18:30 - Main Session: How to Write a Database
19:15 - How we took Clickhouse to Production, Yulia Trakhtenberg

Title: How to Write a Database
Abstract:
Application developers take it for granted that the database will always be there for them, tirelessly serving their reads and writes (hopefully with the same data!). But how does it work?

This talk explores the database internals: commit logs, memory allocation, I/O strategies, and more.

Writing a database is very different from writing an application. The performance demands are strenuous, and because databases carry a lot of state -- their reason for existing -- you can't just keep scaling out as demand rises. The techniques, therefore, for writing a high performance database are quite different.

The talk will cover:

- How to max out SSDs capable of serving hundreds of thousands of I/O operations per second,
- How to fully utilize machines with dozens of cores, How to bypass kernel bottlenecks,
- How to ensure that every byte of memory is utilized efficiently, and much more.

Audience Level:
Technical - Advanced

Bio
Avi Kivity, CTO of ScyllaDB, is known mostly for starting the Kernel-based Virtual Machine (KVM) project, the hypervisor underlying many production clouds. He has worked for Qumranet and Red Hat as KVM maintainer until December 2012. Avi is now CTO of ScyllaDB, a company that seeks to bring the same kind of innovation to the public cloud space.

***As a bonus talk we'll have an additional short war story (~20 minutes) about how we migrated a high-scale real-time ingestion flow from MemSQL to Clickhouse, with production workloads - all through a bottom-up, developer-led, highly successful migration with Yulia Trakhtenberg

Yulia Trakhtenberg is the Data Group Manager at AppsFlyer, with more than 15 years of experience in software development (both backend and frontend), including requirements, architecture, design, coding, testing, quality and customer issues, and nearly a decade of team management and empowerment. Yulia's expertise is around combining deep technical knowledge with understanding of product, business and customer needs.
Some of the "ologies" she likes to dapple in are: Clojure, C++, Ruby, Web, Big data, Java, PHP, NoSQLs, Redis, MySQL, and agile, scrum, automation, management, recruitment, team empowerment.