PyLadies + Spotify: Python Messaging and Hadoop @ Spotify

In partnership with PyLadies, we are excited to announce our first joint Meetup of 2013. This talk will be centered around the various uses of Python at Spotify, and Zanab Hussain from NYC Pyladies will discuss some of her work with Python as well.

Come to learn, network and have a good time. Discussion topics are listed in the schedule below. Also, you guys get to DJ. Click on this link, launch the Spotify app, click "Subscribe" under the playlist title and add songs to the collaborative playlist for the event.


6:30 - 7:00: Mix and Mingle

7:00 - 7:15: Erik Bernhardsson - Python and Hadoop @ Spotify

We use Hadoop internally at Spotify to run 1000s of tasks every day, organized in complex dependency graphs. To support this, we have developed a Luigi, a Python module. Luigi ihelps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. Luigi also powers recommendations, toplists, A/B test analysis, external reports and internal dashboards. In this talk we will cover, the use of Hadoop and Python in developing Luigi.

7:15 - 7:30: Zanab Hussain - Data Scientist.

Basic data exploration with Python. You've got Python. You've got a data set. Now what?? This talk will cover some practical advice for conducting basic data exploration using Python, and how to get the most out of a very simple toolkit.

7:30 - 7:45: Neville Li - Python Messaging @ Spotify

The Spotify backend consists of mostly small services written in Python, each serving a small feature set, e.g. search, social, radio. In this talk we will cover Hermes, a network messaging stack for communicating among these services and the Spotify app. It's built on top of some popular open source software and has some unique features that fit our need. We will also share some lessons learned building services in Python.

7:45 - 8: Q/A Panel

Questions from the audience.

8 - 8:30 - Wrap Up

Join or login to comment.

  • Geert D.

    Meet, socialize and network tonight with Tenzing and many others at the meetup. It is one of the most popular #tech events in NYC today!

    We built an easy-to browse/search page for/with all attendees:

    Happy networking!
    (feedback appreciated!- we're still working on the app;)

    February 27, 2013

  • Todd G

    ack! last minute company obligation...

    February 27, 2013

  • A former member
    A former member

    Take my spot. I wont make it. Enjoy it

    February 27, 2013

  • Anne J.

    can't make this one - hope someone can move off the waitlist now

    February 26, 2013

  • David C.

    David Choy

    February 25, 2013

  • David C.

    David Choy

    February 20, 2013

  • A former member
    A former member

    Looking forward to learn

    February 20, 2013

  • Kathleen M.

    I can't wait to meet everyone and check out the culture of Spotify! See you all there!

    February 19, 2013

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more

I'm surpris ed by the level of growth I've seen since becoming an organizer, it's given me more confidence in my abilities.

Katie, started NYC ICO

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy