WHUG 12. Hadoop At Spotify = Perfect Music For Every Moment ♪♫ ♬ ♯

We are pleased to invite you to the 12th meeting of Warsaw Hadoop User Group, where the presentation about Hadoop at Spotify will be delivered.

Topic: Hadoop At Spotify = Perfect Music For Every Moment ♪♫ ♬ ♯

Speakers: Wouter de Bie, Adam Kawa (Spotify)

Abstract:

http://photos1.meetupstatic.com/photos/event/1/d/d/0/event_219427632.jpegIn the this talk we will give an overview of the Big Data infrastructure at Spotify and explain how Spotify became a real data-driven company. We will discuss real-world problems that we have successfully solved using open-source technologies like Apache Hadoop, Pig, Hive, Luigi, Kafka, Sqoop.

We will also share the most interesting and surprising issues that we have experienced on our cluster, the practical lessons that we have learned by running the cluster consisting of hundreds of machines (still growing quickly!) and processing petabytes of data. We will mention the challenges that we want to attack in the nearest future.

The presentation will take around 1h 30min, plus 15-30 minutes for Q&A.

Wouter de Bie is the Team Lead Analytics and Data Infrastructure at Spotify. He heads up a team of data engineers and is responsible for the data infrastructure and architecture.

Adam Kawa is a Data Engineer at Spotify and his daily job includes implementation of MapReduce jobs and administration of the Hadoop cluster.

Additional information:

http://photos1.meetupstatic.com/photos/event/d/9/f/a/event_221275802.jpegLast, but not least, free pizza and drinks will be available for the participants during the meetup. If you are willing to come, please RSVP to this meetup. This will help us to estimate the number of pizzas and drinks based on declared attendance.

See you at the meeting!

In the meantime you can listen to a bit of great Swedish rap+reggae by Timbuktu (http://open.spotify.com/track/5tAyPMQFAR2u1BbEytn0eH) ;)