Designing Machine Learning Algorithms for Hadoop

This event we will have 2 speakers Erik from Spotify and Blake from Foursquare

We will be livestreaming this event. URL: http://www.livestream.com/spotifyevents (The password prompt will be disabled 10-15 minutes before the event begins.)

Description and Bios:

Blake Shaw - Foursquare
Every day millions of Foursquare users contribute to a rich stream of location data as they move around cities carrying their mobile devices. This data allows us to better understand how people interact with places all over the world. In this talk, we'll walkthrough the various large-scale data mining and machine learning algorithms we have implemented using Hadoop, and how these algorithms power our recommendation engine as well as our venue search API.

Blake Shaw is currently a Data Scientist at Foursquare, a location-based service that helps people keep up with friends and discover new places. At this NYC startup, Shaw applies machine learning algorithms to large spatiotemporal datasets in order to better understand patterns of human mobility. Shaw holds a Ph.D. in Computer Science from Columbia University, and his research has appeared at a variety of conferences including NIPS, ICML, WSDM, and AISTAT. Shaw was also the lead developer of CabSense, a mobile app for predicting the best street corners in New York City for catching taxicabs.

Erik Bernhardsson - Spotify
Spotify uses collaborative filtering to power features like radio, related artists, and the "discover" page. These recommendations are typically based on various latent factor models, like PLSA and other similar models. We will talk about how to scale up the algorithms to run in Hadoop on large data sets, typically 100s of billions of data points, and how to use the output to come up with music recommendations.
Erik Bernhardsson is an Engineering Manager at Spotify, focusing on music discovery and machine learning. He has a master's degree in Physics from KTH in Stockholm.

Special thanks for Spotify sponsoring this event!!

Join or login to comment.

  • Ze

    Hi
    I'm posting this because I need a senior developer for iQuartic. We are a company focused on building a new, unique and revolutionary platform in which healthcare data can be seen and used for cost control, patient diagnosis and treatment using real time electronic health data. Our software will use a lot of machine learning principle. This in turn will change the face of the industry forever. We do not have any qualms about our ambitions - we will build the most unique, disruptive, industry-standard software.
    We have the clients, the funds, and now we need the team.
    Find out more about the position: https://angel.co/iquartic-2/jobs­...¬
    Find out more about iQuartic: www.iquartic.com
    contact [masked]

    September 10

  • Jake B.

    the link for blake's slides no longer works :(

    August 9, 2013

  • Erik B.

    The video is now here: https://vimeo.com/71889190

    1 · August 7, 2013

  • Alex L.

    Great talks. The video recording is available at http://www.livestream.com/spotifyevents

    2 · August 1, 2013

  • Michaylah M.

    Great presentations! Refreshing! Thank you!

    August 1, 2013

  • Huseyin

    Excellent presentations! Will it be possible to have a copy of the slides?

    2 · August 1, 2013

  • David

    Very informative from both speakers and good networking as well. Thank you!

    August 1, 2013

  • Mehul S.

    Great to see a presentation devoid of a sales slant

    1 · July 31, 2013

  • Paul G.

    Great presentations from both speakers!

    July 31, 2013

  • Erik B.

    The venue fits 160 people, and note that it's first come first serve. I increased the RSVP limit to 230 counting on some fraction of dropouts, but there is a risk we might have to stop people at the door in case we are too many. Happy to see so many people wanting to come, but I'm sorry that we have to cap it this way.

    2 · July 31, 2013

    • Erik B.

      I think it's pretty unlikely that we have to turn people away. In that case, we'll make sure the first 160 RSVP's are guaranteed a spot

      July 31, 2013

    • William S.

      Ok, so I stand corrected :)

      July 31, 2013

  • A former member
    A former member

    I am a business guy that attended for the purpose of understanding, conceptually what folks are doing and Erik and Blake did a fantastic job of communicating their approach (even so a business buy could appreciate).

    July 31, 2013

  • Erik B.

    We're going to start right about 7pm, so the stream will be going then. Also, there is still some room here so head over if you're not too far. Thanks for joining us!

    5 · July 31, 2013

    • Erik B.

      Actually, we are going to wait a few more minutes, but the stream is up and ready to go.

      July 31, 2013

    • Sharat M

      wish I had known is earlier... just reached home to watch live stream

      July 31, 2013

  • Sharat M

    Can somebody who is responsible for the live stream fix the live stream please... it frozen

    July 31, 2013

    • Sharat M

      password is not required.

      July 31, 2013

  • Paul R.

    Hope we can watch the recording .

    1 · July 31, 2013

  • Lonnie B.

    6:40 live stream still pwd protected

    July 31, 2013

  • John W.

    Just saw that I was confirmed for the live event, but too late to make it in. Trying to access the live stream - waiting for password to be disabled ...

    July 31, 2013

  • Alex L.

    Thanks to our event sponsor Spotify. We will be livestreaming this event. URL: http://www.livestream.com/spotifyevents (The password prompt will be disabled 10-15 minutes before the event begins.) Also quick reminder, if you not planning to come to event tonight, please update your RSVP status accordingly. We have a huge waiting list. Thanks!

    1 · July 31, 2013

    • Paul R.

      6:31...still asking for password

      July 31, 2013

    • Zhang T.

      has anyone got the password?

      July 31, 2013

  • Stephen S.

    The livestream still seems password protected. Any help in getting in?

    1 · July 31, 2013

    • Paul R.

      Steven, any luck? Paul [masked]

      July 31, 2013

  • John C.

    I needed to remain in Queens due to a family obligation. May I have the password to the Spotify stream?

    July 31, 2013

  • Paul R.

    Will watch the stream.

    July 31, 2013

  • Marvin B.

    I'll drop off and watch the stream - not worth the risk of being #161.

    July 31, 2013

  • Ganesh A. S.

    Can't make it; will join the live stream.

    1 · July 31, 2013

  • Iordan S.

    Work :(

    July 31, 2013

  • Mark W.

    Sorry.. Can't make it.. Something's come up.. Hope someone can use the space

    July 31, 2013

  • Lonnie B.

    for stream

    July 31, 2013

  • John N.

    Will attend via live stream.

    July 31, 2013

  • andy

    Just wondering what's is the password for online streaming?

    July 31, 2013

  • NJ

    Bruno, Alex and Erik,
    I am in California and obviously cannot make it. It would be amazing if we can get a youtube video of the talk after. Or any other recording :)
    Thanks in advance.

    1 · July 30, 2013

    • William S.

      Looks like you got your wish :)

      July 31, 2013

  • Karthik E.

    Will watch the livestream. Someone interested can attend the event.

    July 31, 2013

  • John O.

    Can't make it today :(. My loss is someone else's gain :).

    July 31, 2013

  • Marshall S.

    Attending

    July 30, 2013

  • Shulai Z.

    have an urgent meeting around 6pm. really hope to be there.

    July 30, 2013

  • Ted O.

    Can't make it to NYC

    July 30, 2013

  • A former member
    A former member

    I'm still on the wait list? Do you think everybody who RSVP'd will be attending?
    I really want to attend this meetup

    July 30, 2013

  • Nitin k.

    Can you pl. let us know if we are recording this. Also, it would be great if you let us know what are the pre-requisites or initial reading so we are better versed when we attend.

    July 30, 2013

  • A former member
    A former member

    Will this be recorded and/or slides posted afterwards? Thanks!

    2 · July 30, 2013

  • Mehul S.

    Presenters/Organizers, any recommend reading(s) before the event to get the most out of it?

    1 · July 22, 2013

  • Larry D.

    Wow - maybe they can do a second meetup later on this topic. I'm currently using Hadoop to distribute my Weka runs - I'd be interested to hear what other people are doing.

    July 19, 2013

  • William S.

    Wow, did 140ish people really rsvp for this in 2 hrs? I got an email this morning saying 70 spots left. Go to RSVP two hours later and the waiting list is 76 ppl long! Hahaha

    July 18, 2013

  • Matthew

    I am seeking a data science consultant. Please email me at [masked].

    July 18, 2013

  • Andrew W.

    can't wait

    July 18, 2013

  • Roman K.

    +1

    1 · July 17, 2013

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy