Where "Self-Driving" Database Meets a "Rusty" Distributed Key-Value Store


Details
-
UPDATE 1: A few weeks after announcing this meetup, TiDB 2.0 was released, so we will add a 10-minute presentation by Ed Huang, co-founder and CTO of PingCAP and chief architect of TiDB, to share some highlights of the release! Here's the release blog post for context (https://pingcap.com/blog/tidb-2-0-announcement/)
-
UPDATE 2: Since we have over 150 RSVPs, we will open up the event space at 6PM to give everyone enough time to sign-in, eat, and mingle before the talks begin.
Welcome to the very first event of the Bay Area NewSQL Database Meetup.
We will have catered food (no meetup pizza!), raffle prize (Google Home Mini), and of course intellectually stimulating talks, spanning from "self-driving" DBMS to scaling a key-value store to 100+ nodes using Rust! Please RSVP before we run out of room!
Here are the details:
1st Talk:
By: Andy Pavlo (@andy_pavlo), an Assistant Professor of Databaseology in the Computer Science Department at Carnegie Mellon University. He also used to raise clams.
Title: Make Your Database Dream of Electric Sheep: Designing for Autonomous Operation
ABSTRACT
In the last 20 years, researchers and vendors have built advisory tools to assist DBAs in tuning and physical design. Most of this previous work is incomplete because they require humans to make the final decisions about any database changes and are reactionary measures that fix problems after they occur. What is needed for a "self-driving" DBMS are components that are designed for autonomous operation. This will enable new optimizations that are not possible today because the complexity of managing these systems has surpassed the abilities of humans.
In this talk, I present the core principles of an autonomous DBMS based on reinforcement learning. These are necessary to support ample data collection, fast state changes, and accurate reward observations. I will discuss techniques on how to build a new autonomous DBMS or the steps needed to retrofit an existing one to enable automated management. Our work is based on our experiences at CMU from developing an automatic tuning service (OtterTune) and our self-driving DBMS (Peloton).
- 10-Min Presentation: TiDB 2.0 update by Ed Huang, co-founder and CTO of PingCAP. Here's the release blog post (https://pingcap.com/blog/tidb-2-0-announcement/)
2nd Talk:
By: Siddon Tang (@siddontang), Chief Engineer of PingCAP and team lead of TiKV, a distributed key-value store. He also contributes actively in other open-source projects, like LedisDB, go-mysql, and go-mysql-elasticsearch.
Title: Building a Transactional Key-Value Store in Rust That Scales to 100+ Nodes
Abstract
As a distributed key-value storage engine, TiKV supports strong data consistency, auto-horizontal scalability, and ACID transaction. This talk will focus on how Siddon's team built TiKV using Rust, and how it can scale to 100+ nodes in production environments.
Run of show:
- 6:00PM - Doors open, Dinner begins, Mingling occurs
7:00PM - 1st talk by Professor Andy Pavlo - 7:40PM - TiDB 2.0 update by Ed Huang
7:50PM - 2nd talk by Siddon Tang
8:30PM - Raffling begins (Prize: Google Home Mini; You must be physically present to get the prize)
8:40PM - Event ends
Ping me via meetup if you have any questions. Please RSVP to get your spot and see you at the event!
Kevin

Where "Self-Driving" Database Meets a "Rusty" Distributed Key-Value Store