SHUG 5. Apache Kafka at Spotify (+) Pentaho Data Integration and Hadoop

We are pleased to invite you to the 5th meeting of Stockholm Hadoop User Group! Similarly to the previous meetups, two talks will be delivered this time as well.

Topic: Apache Kafka at Spotify

Speakers: Pablo Barrera (Spotify) and Guido Urdaneta (Spotify)

Abstract: At Spotify we use Kafka as a central component for our log delivery system. Our goal is to send all the data produced in all our hosts into our Hadoop cluster for later processing. By adopting Kafka as part of our pipeline we were able to reduce the average time needed to transfer logs from 4 hours to 10 seconds.

Pablo Barrera is the Product Owner for the Data Collection Squad at Spotify. Guido Urdaneta is a Senior Software Engineer in the same squad. Together they build a distributed log delivery system that allows Spotify to reliably transport all data produced daily from all our hosts to a centralized repository for later processing in just a few seconds.

Topic: Pentaho Data Integration and Hadoop

Speaker: Jonas Björk (BizOne)

This talk will demonstrate how Pentaho Data Integration integrates with Hadoop and how it can be used to operationalize Hadoop using graphical job flow components for easy data orchestration. Since Pentaho Data Integration is Java based it offers a native integration with Hadoop. Pentaho Data Integration is open source and licensed under Apache 2.0 license. Read more at http://www.pentahobigdata.com/ecosystem/platforms/hadoop

Jonas Björk is CTO at BizOne working both as a consultant and with their cloud BI offering which is built on open source software. He has a background in machine learning and data mining research and is a Cloudera Certified Developer for Apache Hadoop.

Additional information

Start time: 19:00

Exceptionally, this meetup will start at 19:00, since the Cafeteria is reserved at 18:00 for the guitar lessons for Spotify's employees.

Pizza and drinks

Thanks to Spotify, pizza and beverages will be available for the participants during the meetup. This is another reason to RSVP to this meetup, if you are willing to come - it will help us to estimate the number of pizzas and drinks based on declared attendance.

RSVP to the meetup

Please RSVP to this meetup, since we need to put everybody on a guest list for entering the Spotify office. The event will be held in the cafeteria of the Spotify office, so don’t go to the normal entrance but to the 11th floor.

The entrance

The door will be open between 18:45 and 19:15* Because of fire regulations, we need to keep a list of everybody in the building, so please make sure that you get your name ticked off the list at the entrance or (in case of a +1), make sure that the person at the door puts your name on the list.

*Unfortunately we can not leave the door open all the time (the company security policy), nor have a person that will be constantly watching for guests coming late. If you really need to come later, please let us know in the comments bellow, so that somebody will come to the door to open it a given time.

See you at soon!

SHUG Team