addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwchatcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgoogleimageimagesinstagramlinklocation-pinmagnifying-glassmailminusmoremuplabelShape 3 + Rectangle 1outlookpersonplusprice-ribbonImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruseryahoo

Python Messaging and Hadoop @ Spotify

In partnership with Spotify, we are excited to announce our first joint Meetup of 2013. This talk will be centered around the various uses of Python at Spotify and Zanab Hussain from NYC Pyladies will discuss some of her work with Python.

Come to learn, network and have a good time. Discussion topics are listed in the schedule below. Also, you guys get to DJ. Click on this link, launch the Spotify app, click "Subscribe" under the playlist title and add songs to the collaborative playlist for the event.

SCHEDULE

6:30 - 7:00: Mix and Mingle

7:00 - 7:15: Erik Bernhardsson - Python and Hadoop @ Spotify

We use Hadoop internally at Spotify to run 1000s of tasks every day, organized in complex dependency graphs. To support this, we have developed a Luigi, a Python module. Luigi ihelps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. Luigi also powers recommendations, toplists, A/B test analysis, external reports and internal dashboards. In this talk we will cover, the use of Hadoop and Python in developing Luigi.

7:15 - 7:30: Zanab Hussain - Basic data exploration with Python

You've got Python. You've got a data set. Now what?? This talk will cover some practical advice for conducting basic data exploration using Python, and how to get the most out of a very simple toolkit.

7:30 - 7:45: Neville Li - Python Messaging @ Spotify

The Spotify backend consists of mostly small services written in Python, each serving a small feature set, e.g. search, social, radio. In this talk we will cover Hermes, a network messaging stack for communicating among these services and the Spotify app. It's built on top of some popular open source software and has some unique features that fit our need. We will also share some lessons learned building services in Python.

7:45 - 8: Q/A Panel

Questions from the audience.

8 - 8:30 - Wrap Up

Join or login to comment.

  • A former member
    A former member

    This was a wonderful meetup! Great speakers, presentations were just the right length, and the topics were engaging.

    March 1, 2013

  • Jean B.

    Really informative and interesting chat.

    February 28, 2013

  • Sara M.

    Thanks for hosting this awesome meetup!

    February 27, 2013

    • Emily C.

      Thanks for coming, Sara! It was great to meet you tonight.

      February 28, 2013

  • Robin Camille D.

    Sounds really awesome — wish I could go :'(

    February 19, 2013

    • Kat C.

      Wish you were able to make it!

      February 27, 2013

  • Katie I.

    Ah unfortunately won't be able to make it to this one!

    February 27, 2013

    • Kat C.

      Aww that's too bad. Hope you can make it to future events.

      February 27, 2013

  • Carlos A. P.

    Had a lot of fun and it was very informative.

    February 27, 2013

    • Kat C.

      Great to hear! Glad you were able to attend.

      February 27, 2013

  • Kat C.

    Feel free to share any photos from the event! I uploaded a couple.

    February 27, 2013

  • Geert D.

    Meet, socialize and network tonight with Emily and many others at the meetup. It is one of the most popular #tech events in NYC today!

    We built an easy-to browse/search page for/with all attendees:
    http://bit.ly/ZBAqji

    Happy networking!
    (feedback appreciated!- we're still working on the app;)

    February 27, 2013

  • Emily C.

    Hi everyone, Looking forward to tonight's event. The presentations will start at 7pm sharp so please try to arrive on time as to not disturb the talks.

    See you at Spotify!
    Emily

    February 27, 2013

  • Jean B.

    Neat.

    February 19, 2013

58 went

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy