addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1linklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Hadoop At Spotify = Perfect Music For Every Moment ♪♫ ♬ ♯

Energy level at 100% after the long weekend? Good! There is something great we all have been waiting for. :) We are happy to invite you for the previously postponed presentation from our friends at Spotify.

We set the limit of guests to 60. If we will find a larger venue, we will increase it, so you can keep registering.

Topic: Hadoop At Spotify = Perfect Music For Every Moment ♪♫ ♬ ♯

Speakers: Wouter de BieAdam Kawa (Spotify)


In the this talk we will give an overview of the Big Data infrastructure at Spotify and explain how Spotify became a real data-driven company. We will discuss real-world problems that we have successfully solved using open-source technologies like Apache Hadoop, Pig, Hive, Luigi, Kafka, Sqoop.

We will also share the most interesting and surprising issues that we have experienced on our cluster, the practical lessons that we have learned by running the cluster consisting of hundreds of machines (still growing quickly!) and processing petabytes of data. We will mention the challenges that we want to attack in the nearest future.

The presentation will take around 1h 30min, plus 15-30 minutes for Q&A.

Wouter de Bie is the Team Lead Analytics and Data Infrastructure at Spotify. He heads up a team of data engineers and is responsible for the data infrastructure and architecture.

Adam Kawa is a Data Engineer at Spotify and his daily job includes implementation of MapReduce jobs and administration of the Hadoop cluster.

Additional information:

Last, but not least, free pizza and drinkswill be available for the participants during the meetup. If you are willing to come, please RSVP to this meetup. This will help us to estimate the number of pizzas and drinks based on declared attendance.

See you at the meeting!

In the meantime you can listen to a bit of great Swedish rap+reggae by Timbuktu;)


Join or login to comment.

  • Adrian W.

    great presentations! see you next time

    1 · May 10, 2013

  • Przemek M.

    Yay, It's tomorrow! To anyone waitlisted - if you don't mind standing (perhaps) - you are welcome to join us!

    May 9, 2013

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy