Workload Distribution

  • March 21, 2013 · 6:00 PM

Pizza, beer, and mingling.

"Mesos - Cluster Management @ Twitter"
Benjamin Hindman - Tech Lead, Twitter

"Reliable JVM Concurrency & Distribution with Akka"
Brendan McAdams - Consultant/Instructor, Typesafe


Scaling an application requires distributing the work across multiple servers to get more done. For a web tier, this is pretty well understood, and we use load balancers (hardware or software) to spray requests across the tier.

For other types of work, a load balancer may not be enough. Your application may require acknowledgement of completion, or may require the ability to chain together many events. Stateful processing may also have other needs, such as assuring data co-locality in order to avoid sending large messages around.

This month's theme is "Workload Distribution." I'd like to hear about the kinds of tasks folks are distributing throughout their applications, and how they are doing it. There are a growing number of middleware components for managing this; a few examples include Apache Mesos, Gearman, and Akka.

Do you have an application that is using this technique to distribute work across a set of hosts? What is the workload, and how do you distribute it? Can you tell us what led you to use the framework you chose? What do you like or dislike about it? What is the programming model like? How easy/hard is it to scale the system by adding more nodes? How do you tell when the system needs more resources?

For our March event, I'd like to see talks about Workload Distribution, who's doing it, and how they're doing it.

I'm looking for[masked] minute talks. If you can give a talk, please contact me, Chris Westin, through meetup.

As well as the evening's theme talks, we can fit in 2-3 five minute lightning talks at the beginning of the evening; any topic that would be interesting to the #lspe audience is welcome. If you're interested in giving a lightning talk, contact me, Chris Westin, through meetup.

Note that the March event we will be in San Francisco, where Twitter have offered to host us. We know there are folks in SF that follow us and would like to attend, our events, so this is your chance! Twitter is in suite 900, you will need to register at reception, and show ID; I'm told this will go faster if you've RSVPed. Please allow time for that. Also note that the venue is a little smaller than our usual, so please update your RSVP if your situation changes and you cannot attend.

Join or login to comment.

  • Sean C.

    would love to see the slides from this.

    1 · March 22, 2013

    • Chris W.

      As usual, I have requested them from the presenters, and will post them here when I get them.

      March 22, 2013

  • Stoney V.

    Great presentations

    1 · March 21, 2013

  • Jochen R.

    Great talks, informative and inspiring

    1 · March 21, 2013

  • Zac

    Me too. Can anyone escort me up?

    March 21, 2013

  • Ricardo S.

    At the Twitter lobby, can someone escort me up?

    March 21, 2013

  • Peter L.

    Work late :(

    March 21, 2013

  • Bernie

    What time do the presentations start? Thanks!

    March 21, 2013

  • Eddie W.

    something came up at work :(

    March 21, 2013

  • Dave D.

    Damnit, can't go now. Have fun!

    March 21, 2013

  • pavan d.

    Coburn....something came up and I cant attend....my spot is available

    March 18, 2013

    • Chris W.

      I just heard back from Twitter, and unfortunately, 90 is the best we can do. Hopefully folks will be good about changing their RSVPs if they can't really go.

      March 18, 2013

    • Coburn

      and all this after a discussion on dynamic capacity planning ;-) hopefully it will be recorded/posted. Thanks for coordinating Chris.

      March 21, 2013

  • Leon K.

    How is waiting list gets updated I see some people cannot make it but I still do how big is the list? Thank you

    March 20, 2013

    • Chris W.

      On the top right of this page, it currently says there are 66 people on the waiting list. Unfortunately, as far as I can tell, it doesn't tell you your position.

      March 21, 2013

  • Matthew B.

    Sudden change of plans so I relinquishing my spot. Was really looking forward to this one.

    March 20, 2013

  • Robert N.

    In case anyone's stuck in the south bay and would still like to network with some fellow systems folks, BayLISA is having two talks on SSL management and one on network virtualization. We're meeting at Yahoo building E at 7:30pm. Details/rsvp at http://www.meetup.com/BayLISA/e...­

    March 20, 2013

  • Aaron F.

    Sudden business trip :(

    March 18, 2013

  • Coburn

    Anyone know if more space is going to open up for Workload Distribution?

    March 18, 2013

  • Sean C.

    I will be at a PyCon saltstack meetup this friday, 5p at SC convention ctr, room GAMR1 and hope you all can join me there or I'll see you next time! http://lanyrd.com/2013/saltpy/­

    March 14, 2013

  • Shreesh H.

    Building a video startup with heavy data mining and ai...so any help on work management is great

    March 6, 2013

  • Craig M.

    Great talks last night. Thanks,

    1 · February 22, 2013

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Start your Meetup today

Act now and get 50% off.
Until February 1.

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy