BookKeeper June 2016 meetup (San Francisco)

Salesforce along with Apache BookKeeper community organizing a meetup and would like to invite enthusiasts and evangelists of distributed systems. We will be discussing technologies around cloud storage, massaging, and share experiences of using open source projects like Apache BookKeeper and consensus protocols like Raft. Please RSVP and join us for an evening of food, drinks, talks and networking

Agenda:

5:30 PM - 5:55 PM Check-in & Network & Food/Drinks

5:55 PM - 6:00 PM Opening and Welcome (Jim Walsh, SVP, Infrastructure Engineering, Salesforce)

6:00 PM - 6:30 PM Bookie Storage. Current implementation and new experiments (Yahoo)

6:30 PM - 7:00 PM Running Bookkeeper At Twitter (Twitter)

7:00 PM - 7:30 PM Runway: A new tool for distributed systems. (Salesforce)

7:30 PM - 8:00 PM Panel Discussion

8:00 PM - 8:30 PM Discussions & Network

Bookie Storage. Current implementation and new experiments (Matteo Merli, Yahoo)

This talk will do a deep dive on the current incarnation of the bookie storage layer and how that enables high throughput and low latency writes. After that, Matteo will present current changes used by Yahoo and some early experiments that are currently ongoing

to use RocksDB as the data storage to better handle mixed workloads and minimize impact of JVM GC on write latencies.

Matteo Merli is a BookKeeper PMC and the tech lead for Yahoo distributed pub-sub messaging service.

Running Bookkeeper At Twitter (Franck Cuny, Twitter)

Bookkeeper is at the core of the messaging systems at Twitter. In this talk Franck Cuny will talk about the benefits and challenges of running Bookkeeper at large scale, including how Twitter runs BookKeeper on Apache Mesos, how to monitor and operate this clusters. He will also cover the future work on improving operations and reliability.

Franck Cuny (@franckcuny (https://twitter.com/franckcuny)) is a SRE for the Messaging team at Twitter.

Runway: A new tool for distributed systems (Diego Ongaro, Salesforce)

Runway is a new distributed system design tool, combining specification, model checking, simulation, and visualization. Diego will give a brief overview of Raft, Runway and present the Runway model of the Raft consensus algorithm, which manages a single replicated log. A similar approach could be used to model BookKeeper's internals and future enhancements

Diego lives in San Francisco and works on the Compute System team at Salesforce. He's interested in distributed systems and formal methods, and is developing a new tool called Runway that combines visualization, simulation, and model checking. Diego received his PhD in 2014 from Stanford, where he was advised by Professor John Ousterhout. During his doctorate, he worked on RAMCloud (a 5-10 microsecond round-trip key-value store), the Raft consensus algorithm (used in etcd), and LogCabin (a production-ready coordination service built with Raft). https://ongardie.net (https://ongardie.net/)

Panel Discussion

A Panel discusses what is coming in BookKeeper 4.5.0 release and how to scale BookKeeper’s metadata.

Moderator:

Sameer Tiwari, is a Principal Cloud Architect at Salesforce working on building scale out storage systems for both transactional and non transactional workloads. Before joining Salesforce, he was working on Ad-Serving and User Platform systems at Yahoo and was the Hadoop Architect at Pivotal, building storage systems extensions for Big Data Analytics.

Panel:

JV Jujjuri (Venkateswararao Jujjuri), is a cloud storage architect at Salesforce leading an effort to build cloud storage services and a Apache Bookkeeper committer. Prior to this JV worked at IBM’s Linux Technology Center and worked on multiple storage technologies including NFS-Ganesha, a user-space NFS server, VirtFS filesystem, Distributed File Systems (SANFS), Clusters(HACMP) and storage virtaulization (SANVC), realtime kernel, Multipath device drivers, and various components of storage stack.

Sijie Guo, is a staff software engineer at Twitter, where he is tech lead of Twitter messaging team and the PMC chair of Apache BookKeeper.

Matteo Merli is a BookKeeper PMC and the tech lead for Yahoo distributed pub-sub messaging service.