addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupsimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1outlookpersonJoin Group on CardStartprice-ribbonImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruseryahoo

[NYC Hadoop meetup] Rapid Data Exploration with Hadoop (LinkedIn) 3/18

Rapid Data Exploration with Hadoop (LinkedIn) 3/18 LinkedIn is the premiere professional social network with over 60 million users and a new user joining every second. One of LinkedIn's strategic advantages is their unique data. While most organizations consider data as a service function, LinkedIn considers data a cornerstone of their product portfolio. To rapidly develop these products LinkedIn leverages a number of technologies including open source, 3rd party solutions, and some we've had to invent along the way. This talk will discuss some best practices for quickly uncovering patterns, visualizing trends, and generating actionable insights from large datasets. We will also walk through a few basic examples that use Hadoop, Pig, Voldemort, & Python to perform tasks related to trend detection, spatial analytics, & collaborative filtering.
Pete Skomoroch is a Research Scientist at LinkedIn, focusing on building data driven products. For the past several years, he was founder of Data Wrangling in Washington, DC, working on projects involving search, finance, and recommendation systems. Previously, he was the Director of Advanced Analytics at Juice Analytics and a Sr. Research Engineer at AOL Search.
http://www.linkedin.c... Blog:
http://www.datawrangl...

Join or login to comment.

  • Alex D.

    Thanks again to Pete for great presentation. Here is link to the slides on slideshare
    http://www.slideshare.net/pskomoroch/rapid-data-exploration-with-hadoop

    video (thanks to Michael Tiffany)
    http://sharing.theflip.com/session/63632537ecde04f3027798ecfa914414/video/11760609

    -Alex

    April 20, 2010

  • Brian M.

    Interesting glimpse at the technology, data resources and approach of the LinkedIn team. More detail on the use of Hadoop and supporting technologies would have been a plus, but the talk was good and covered a lot. Thanks as always Alex for consistently finding interesting presenters.

    March 19, 2010

  • Edward L.

    This meeting was more focused on how LinkedIn works rather than how they use hadoop. It would of been nicer to see it from a different angle. But overall its interesting to see how people are using the same technology.

    March 18, 2010

  • A former member
    A former member

    Awesome presentation topic! I was amazed at how much data those guys have and how they're using it. Very informative.

    March 18, 2010

  • Alex D.

    I got a tripod. thanks guys.

    March 18, 2010

  • A former member
    A former member

    I just happen to be walking around with a Flip HD today that we could use; bonus if someone has a tripod but we could simply mount it on a desk or table.

    March 18, 2010

  • Alexander S.

    otis, i wish i could. have a last minute conflict. i changed my rsvp to no so hopefully someone can get in.

    March 18, 2010

  • Otis G.

    Alex, I'm wondering if you could video record this meetup? Thanks.

    March 18, 2010

  • Alex D.

    yes, Pete will be at the meetup in person.

    February 28, 2010

  • A former member
    A former member

    Will Skomoroch actually be at this meetup in person, or will this be a videconference-based presentation?

    February 28, 2010

60 went

Your organizer's refund policy for [NYC Hadoop meetup] Rapid Data Exploration with Hadoop (LinkedIn) 3/18

Refunds offered if:

  • the Meetup is cancelled
  • the Meetup is rescheduled
  • you can cancel at least 0 day(s) before the Meetup

Payments you make go to the organizer, not to Meetup. You must make refund requests to the organizer.

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy