Building a distributed coordination service at Facebook scale

Building highly reliable and elastically scalable backend services is critical for serving web workloads like Facebook’s. At the heart of such services is a distributed coordination service. Zookeeper was evaluated at Facebook for this and we found its performance and scalability inadequate. Project Zeus was started to solve this problem, with the Zookeeper code base as a starting point. Zeus significantly improved upon Zookeeper and added several features and performance enhancements that were required for our workload. 

Join Vishal Khaturia and learn more about the Facebook workload, how Zookeeper fared on that workload and a dive in to the architectural elements and features in Zeus that enabled it to handle this workload well.

A little about Vishal, he is an engineer at Facebook and he works on making services at Facebook fault tolerant, elastically scalable and reliable in the presence of dynamically changing workload. He led the design and development several systems at Facebook, including Zeus: Facebook wide coordination service, Facebook’s service discovery and shard management systems and a fault tolerant distributed key/value store. Prior to Facebook, Vishal was a lead engineer at Microsoft on a skunks works project to build a large scale distributed database system.


Want an Uber driver to get you here? Get $20 off your first ride Text SVCLOUD to 827-222.You can also sign up at uber.com/go/SVCLOUD

Join or login to comment.

  • Roger R.

    Is there going to be another one of these events?

    Rog
    about.me/roger.rustad

    March 23, 2014

  • Javier G.

    I wanted to thank Vishal (Speaker) and Alexander (organizer) on Behalf of Akamai (www.akamai.com) who hosted the event yesterday. In case you never heard about Akamai, we are the leading cloud platform for helping enterprises provide secure, high-performing user experiences on any device, anywhere. The Akamai Intelligent platform has 130 thousand servers (and growing daily) distributed worldwide in around 1200 "different" networks, delivering around 30% of all the traffic on the Internet. Sounds cool? Want to join us? We have over 30 open positions on the Bay Area. See http://www.akamai.com/html/careers/index.html

    1 · December 12, 2013

    • Sebastian

      Hi Javier, while we appreciate Akamai hosting the group, we'd prefer to tone down the amount of promotional comments posted to the group. If you are interested in a sponsorship, please contact one of the organizers.

      Cheers,

      December 14, 2013

  • Henry S.

    Will the presentation be published later for those who cannot attend?

    December 10, 2013

    • Shingo O.

      However, the speaker mentioned that they are working on publishing a blog post about Zeus on facebook engineering blog and also he saids that he will put a link to this page when it comes.

      1 · December 12, 2013

    • Alexander S.

      Awesome! thanks Shingo.

      December 12, 2013

  • Chris O.

    A very informative presentation by Vishal Khaturia! Facebook is breaking new ground, and I personally love to see/hear about this type of project!

    1 · December 12, 2013

  • Joseph W.

    Great presentation. He went over a lot of scenarios and changes that they made to Zeus to scale.

    1 · December 12, 2013

  • A former member
    A former member

    For those of you who asked for/want more details on HyperSpot and Bluetooth Beacons, you can go to hyperspot.info (for links to the facebook page) and point your mobile phones to http://gh.hyperspot.info and to get access to the CloudComputing Meetup's HyperSpot w/links, chat, perks etc. You can reach me directly at ssriram gmail -

    1 · December 11, 2013

  • Shailen S.

    Will it be streamed?

    December 1, 2013

    • Alexander S.

      Hi Shallen,

      Unfortunately this event will not be streamed.

      December 6, 2013

  • Joseph W.

    parking information?

    November 17, 2013

    • Alexander S.

      Hi Joseph,

      Parking is no problem. Akamai has available parking spots at their offices.

      December 6, 2013

Our Sponsors

  • CloudStack

    CloudStack (cloudstack.org) is an open source cloud computing platform.

  • Scalr

    Cloud management software

  • Ubuntu

    Ubuntu is the open source cloud OS, supported by Canonical.

  • Pivotal

    Redefining PaaS for enterprise, leveraging big fast data.

  • Rackspace

    The open cloud company and OpenStack co-founder

  • HP

    To learn more about HP’s cloud solutions, visit hp.com/go/cloudtalk

  • AWS

    Pay-as-you-use cloud computing services for everyone

  • General Catalyst

    Funds breakthrough ventures and backs exceptional entrepreneurs.

  • Aruba Networks

    Aruba provides next-gen network solutions for the mobile enterprise.

  • Riverbed Stingray

    Riverbed Stingray: Fast, reliable, secure applications in the cloud

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy