Architecture of an Open Source RDBMS powered by HBase and Spark

6:00-7:00: Socializing (food, beverages - thanks New Relic (https://newrelic.com/)!)
7:00-7:10: Announcements
7:10-8:30: Architecture of an Open Source RDBMS powered by HBase and Spark
8:30-8:45: Q & A

Abstract:

Splice Machine is a java-based open-source database that combines the benefits of modern lambda architectures with the full expressiveness of ANSI-SQL. Like lambda architectures, it employs separate compute engines for different workloads - some call this an HTAP database (Hybrid Transactional and Analytical Platform).

This talk describes the architecture and implementation of Splice Machine V2.0. The system is powered by a sharded key-value store for fast short reads and writes, and short range scans (Apache HBase) and an in-memory, cluster data flow engine for analytics (Apache Spark). It differs from most other clustered SQL systems such as Impala, SparkSQL, and Hive because it combines analytical processing with a distributed Multi-Value Concurrency Method that provides fine-grained concurrency which is required to power real-time applications.

This talk will highlight the Splice Machine storage representation, transaction engine, cost-based optimizer, and present the detailed execution of operational queries on HBase, and the detailed execution of analytical queries on Spark. We will compare and contrast how Splice Machine executes queries with other HTAP systems such as Apache Phoenix and Apache Trafodian. We will end with some roadmap items under development involving new row-based and column-based storage encodings.

Speaker: Jun Yuan, Principal Engineer at Splice Machine

Jun is a Principal Engineer at Splice Machine who focuses on the SQL optimizer, executors, backup and restore capabilities of the software. He has over 10 years optimizing Java and databases with a history that includes 5 years at Oracle as a senior member of the technical staff focusing on Oracle Streams and GoldenGate.

http://photos1.meetupstatic.com/photos/event/b/a/0/8/600_453707624.jpeg