addressalign-toparrow-leftarrow-leftarrow-right-10x10arrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcredit-cardcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobe--smallglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1languagelaunch-new-window--smalllight-bulblinklocation-pinlockm-swarmSearchmailmediummessagesminusmobilemoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahooyoutube

The Legends of Twitter and Beyond: the Real-World Architectures Panel at Scale By the Bay, 11/16

From: Alexy K.
Sent on: Monday, October 9, 2017 11:32 AM

Folks — we are super happy to introduce the Real World Architectures panel at Scale By the Bay, the likes of which you’ve never seen before.

We’re happy to host the Legends of Twitter: the principals who invented, articulated, built, open-sourced, and eventually founded companies around the new stack, the software architectures and tools with which the companies of tomorrow will be built.

You can think of Twitter, Facebook, Google, Amazon, etc., as a preview of what the scaleable companies and apps of the future will look like.  They are built on a version of the SMACK stack allowing millions of endpoints interacting in real time, messages aggregated via reactive APIs and message buses, microservices working together to process them, ML engines making decisions and the system actuating it back to the millions of the end users.  Meanwhile, the system runs on an elastic operational layer and the data is stored reliably, even when processed at memory speeds.

In Twitter world, Finagle, lead by Marius Eriksen, is the RPC layer allowing to build compassable distributed systems with service discovery, advanced routing, etc.  Marius is now at GRAIL, developing new ways to run cloud workflows.  In the wild, it is LinkerD, by Buoyant, lead by fearless William Morgan.  The operational layer is Mesos, lead by Ben Hindman, now a cofounder of Mesosphere.   Ben will join a fireside chat during the Happy Hour following the panel on the opening day.  The storage was lead by Evan Weaver, whose new database, and company, Fauna, is changing the way we write data-centric data pipelines.  We will also have a talk from Starbucks about their use of Fauna.  The way these tools are built at Twitter was lead by Mark McBride, now a founder at Turbine labs.  Developer productivity is key and Turbine ensures you ship more and worry less.

Outside Twitter, the SMACK stack is lead by Kafka and Spark, with the storage engines such as Cassandra, also running on Mesos.  Akka may serve as the message layer.  Helena Edelson, a lead at Apple implementing a new generation of services using it, will open the conference with her keynote and join the panel.

We also publish Q&As with the panelists answering the same eight questions about their work at Twitter and beyond on our conference blog,

There is a whole track on Reactive Microservices extending the ideas of the panel.  Come and get a year’s worth at Scale!  Use the code SFSCLA15 for 15% off and reserve your seat (while the supplies last!).

People in this
group are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy