Elastic Storage - how to manage data in a very large application

  • June 4, 2014 · 6:00 PM
  • Yahoo Trondheim

(rescheduled from May 14 due to time constraints - sorry)

Yahoo implement services using very large data sets - sets that are rapidly growing. This meetup will cover the distribution algorithm we use for stateful, elastic systems. We will discuss pros and cons of algorithmic placement and challenges of distributed knowledge of the service states in the cluster. Finally, we will discuss real world use cases to illustrate what it is like to develop and manage services of global scale.

This is a good opportunity to get insights into the inner workings of one of the world's largest search applications - this really is Big Data

Kristian Aune and Tor Brede Vekterli from Yahoo will hold presentations - please suggest other talks we can add to the agenda, too, it could be lightning talks.

Join or login to comment.

  • Dirk A.

    Sorry everyone, but I will be away on the 17th. In case you want to reschedule, I would be available the 3 weeks after that.
    Alternatively, Massimiliano would also have a contribution towards Geospatial Data.

    August 21

    • Massimiliano

      Hei! I would like to give the contribution on that but I am not available on 17th of Sept. Rescheduling would be fine for me.

      August 22

    • Kristian A.

      Dirk/Iván/Massimiliano: We will reschedule to Sept 24 18:00. We appreciate your contributions, looking forward to it!

      August 25

  • Kristian A.

    OK, we will schedule for Wednesday September 17 then - thanks Iván and Dirk! Can the two of you please work out a good title for this meetup? Also suggest location - we can do it at Yahoo unless others propose a good location

    June 13, 2014

  • Iván S.

    If you want me to speak about geospatial databases, keep in mind I'll be in the USA between september 8th and 13th (at least).

    June 10, 2014

  • Dirk A.

    For the September meetup, we should schedule if for sometime after the first week, when I am not available.

    June 10, 2014

  • Kristian A.

    "CRUSH: Controlled, Scalable, Decentralized Placement of Replicated Data": www.ssrc.ucsc.edu/Papers/weil-sc06.pdf

    1 · June 10, 2014

  • Kristian A.

    Thank you to all that attended! We agreed that the next meetup is in September, and we will talk about Geospatial Data and Location-based Search. Iván Sánchez and Dirk Ahlers will hold presentations

    June 10, 2014

  • Petter W.

    Very interesting. Thanks for hosting this and giving such great presentations.

    2 · June 4, 2014

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy