GoSF Meetup - Mesos + Go | Stream Multiplexing | Dependency Mgmt

  • February 19, 2014 · 6:30 PM

Agenda  

6:30 Networking | Food | Drink 
7:00 Tools, Tips and Best Practices 
7:15 Speakers 

• Talk 1: Building Distributed Systems with Mesos and Go (Niklas Nielsen) 
• Talk 2: Stream Multiplexing in Go (Alan Shreve)
• Talk 3: Dependency Management (Keith Rarick)

8:30 End 


Talk 1: Building Distributed Systems with Go and Mesos  

Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. In this talk, Niklas will go over how to write frameworks for Apache Mesos in Go. 

It can run Apache Hadoop, MPI, Hypertable, Apache Spark, Storm, Chronos, Marathon, and other applications on a dynamically shared pool of nodes. The biggest user of Mesos is Twitter, where it runs on thousands of servers. Airbnb runs all of their data infrastructure on it, processing petabytes of data.

This talk will:

• Give a brief overview of Mesos architecture and the resource/allocation flow and touch base on the Mesos API’s.

• Walk through an example framework and executor in Go on screen.

The primary goal of the discussion is to get feedback from the audience on how Go developers would like interact with Mesos. Please come ready with input to better drive the roadmap and Go interfaces.

About the Speaker

Niklas Nielsen is a software engineer at Mesosphere and committer in the Apache Mesos open source project.


Talk 2: Stream Multiplexing in Go

Alan Shreve will talk about stream multiplexing in Go as a foundation for RPC. Specifically, he'll cover the Muxado library he built for this purpose. (https://github.com/inconshreveable/muxado). In particular, he'll go over details that include:

• Explain how muxado makes a great building block for custom protocols and RPC
• Outline the design of the public API
• Go over some of the clever tricks employed in the implementation to make muxado fast

About the Speaker

Alan Shreve hacks on everything from operating system kernels in C to rich client applications in Javascript. He's the author of the popular developer tool ngrok and a growing amount of open-source Go packages. 

While at Twilio, he architected and wrote fast, scalable, fault-tolerant distributed systems that powered the SMS and Voice stacks. He currently works on fixing analytics, building out the distributed systems that power Keen IO. @inconshreveable


Talk 3: Dependency Management (Keith Rarick) 

Keith Rarick will give a brief overview of the state of dependency management tools for Go applications and then provide a detailed run-through of godep, including initial setup, collaboration, updating dependency packages, working with third party tools,and deploying to Heroku, as well as godep's general philosophy of operation – why it works the way it does.

About the Speaker

Keith Rarick works on systems, both distributed and non-. He was part of Heroku until very recently, and now enjoys a return to the crazy experimental life of an early-stage startup.


About the Sponsor/Host

Heroku is a cloud application platform – a new way of building and deploying web apps. Developers can focus 100% on code and never think about servers, instances, or VMs again. Hundreds of thousands of developers have already deployed millions of apps to Heroku. (@heroku)


Other Sponsors

Iron.io is the maker of IronMQ, a scalable cloud-based message queue, and IronWorker, an elastic task queue/worker service and one of the first companies to use Go in production. Iron.io's services are designed for doing things asynchronously and operating at scale. (@getiron)


High Scalability is the best source for information on building bigger, faster, and more reliable websites. (@highscal)

Join or login to comment.

Our Sponsors

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy