Data Infrastructure @ LinkedIn

  • May 24, 2012 · 7:00 PM
  • Box

With over 150 Million members worldwide, LinkedIn is an indispensible means to connect professionals the world over. By mining data from its ever-growing professional network, LinkedIn recommends jobs, connections, skills, and ads to its members. Using this same information, LinkedIn has proven itself a reliable hiring tool for companies in search of skilled talent. As LinkedIn continues to grow in popularity and features, its need for fast access to large sets of rapdily evolving data will grow. How are we handling these challenges? Come and find out about LinkedIn's data infrastructure technologies.

Join or login to comment.

  • Siddharth "Sid" A.

    Helix will be open sourced this Summer. The rest of Espresso will take a bit longer to open source.

    May 29, 2012

  • ruxmcs

    Thanks to Sid's talk, it's informative. For Espresso, I saw Linkedin mentions it: http://engineering.linkedin.com...­ but i cannot find further info on the web. Will it be open source soon? thanks.

    May 25, 2012

  • Praveen K.

    Great presentation, thanks Sid.

    May 25, 2012

  • Siddharth "Sid" A.

    Everyone, thanks for your comments. We will be publishing an article on Helix on HighScalability.com in a few weeks. We will have a follow up talk just on Espresso, and we will cover it in sufficient depth. For all items except for Espresso, you can refer to the QCon London talk link below. You can follow me on twitter for announcements @r39132

    Happy Memorial Day Weekend!
    Sid

    May 25, 2012

  • A former member
    A former member

    A general introduction, We need deeper divings :)

    May 25, 2012

  • Adarsh U

    Good

    May 25, 2012

  • Shilpa K.

    It was a lot of content for the time at hand, and though it felt rushed at times, there was significant new information. I found it valuable despite the high number of NoSQL meetups happening in this area. Thanks to Sid for the presentation & the Q&A time after the talk.
    Thanks to the organizers - for the event, live streaming, and making the video available the next day!

    May 25, 2012

  • Siddharth "Sid" A.

    Roy,
    Definitely check out the London talk.

    Feel free to email me and I will put you in touch with project leads if I cannot answer your questions.

    Warm Regards,
    siddharthanand at yahoo dot com

    May 25, 2012

  • Siddharth "Sid" A.

    FYI, I was arguably rushed with this talk. A less rushed version was presented in London in March. I cover everything but Espresso. Enjoy.

    http://www.infoq.com/presentati...­

    May 25, 2012

  • Benjamin L.

    Good Job !

    May 25, 2012

  • A former member
    A former member

    A lot of material was presented, but covered too quickly to allow for in depth questions. Such compelling material deserved 3x the time that allotted. Personally, I find an understanding of the technical journey of a company like LinkedIn is at least as interesting as an understanding of its current technical state, and much harder to get without being an insider. With more time, attendees would have gotten a better understanding of what drove LinkedIn in their path to their current data infrastructure. In an ideal world, some glimpse into the future would have been great, because LinkedIn is at the cutting edge of distributed data infrastructure. Fortunately, Siddharth Anand has been extremely helpful in filling the gap with his comments.

    May 25, 2012

  • Mase W.

    Very complex and hard to understand

    May 25, 2012

  • A former member
    A former member

    Great presentation

    May 25, 2012

  • Andres Le R.

    I thought this was a cloud event, and most of the talk was on databases...

    May 25, 2012

  • bill c.

    Using numerous data infrastructure is interesting, it may be a challenge if one of those vendors decide to not play nice.

    May 25, 2012

  • A former member
    A former member

    Incredibly complex. Not sure I understand why five layers are needed...

    May 25, 2012

  • Willie L.

    I will discuss details of mobile cloud architecture soon.

    May 25, 2012

  • Siddharth "Sid" A.

    Slides now available from my Data Infrastructure @ LinkedIn Meetup talk (May 2012) http://bit.ly/MMafD9­

    1 · May 24, 2012

  • xyz

    Do we have chance to get the ppt?

    May 24, 2012

  • Ferhat H.

    55 or so viewers on the livestream. full house at Box.net. Great to have you all.

    May 24, 2012

  • Ferhat H.

    May 24, 2012

  • Willie L.

    NO, Nothing upon Apple, it is an open tech for everyone. I just take Apple as an example, and can also take Google as example.
    Apple just started this mobile cloud development, and other companies also started such development. Like cloud computing, it is an emerging hot topic.

    May 24, 2012

  • Ferhat H.

    Transportation to the event:

    Map of the venue: http://g.co/maps/9pgp6­

    1) Caltrain: Get down at San Antonio station and walk to El Camino Real, on Del Medio.

    2) Bus: 22 or 522, get down at El Camino and San Antonio. Box is right there.

    3) Driving? Park in any of the following places:

    - In the parking lot of adjacent building (4410 El camino Real, Box leases most of that building too). There is parking surrounding the building, and there is also an underground lot.

    - On the street (El Camino

    May 24, 2012

  • Willie L.

    Yes, iPhone's NG thru Ver.8 will be focusing on mobile cloud movement, supported by various patent applications from Apple.

    May 24, 2012

  • David S.

    This Looks Cool! As a Followup, consider: "SmartUp: Big Data Recruiting," featuring the founders of GoodData, TalentBin, Bright, and SmartRecruiters. Short Presentations, Networking, Drinks, Questions and Answers from the audience and Twitter. June 6th. https://www.facebook.com/events/...­

    May 24, 2012

  • Willie L.

    I suggest to organize a event on "Mobile Cloud architcture for User-centric mobile devices". Mobile Cloud is different from Cloud computing, and it converges cloud computing, cloud networking, open wireless and seamless mobility into one common platform for the future User-centric (instead of Carrier-centric currently) mobile devices. iPhone 5-8 will be targetting on this mobile cloud movement (from carrier-centric to user-centric), and Apple is actively working on this new architecture.

    May 24, 2012

  • Siddharth "Sid" A.

    Thanks Ferhat!

    May 23, 2012

  • Ferhat H.

    live streaming: tune into http://www.ustream.tv/channel/s...­ and x-fingers :)

    May 23, 2012

  • Siddharth "Sid" A.

    Re:live streaming, I'm trying to get a hold of the organizers. Will send an update to this list and twitter once I find out!

    May 23, 2012

  • Chris W.

    Re https://twitter.com/r39132/statu...­ any details on the live streaming?

    May 23, 2012

Our Sponsors

  • CloudStack

    CloudStack (cloudstack.org) is an open source cloud computing platform.

  • Scalr

    Cloud management software

  • Ubuntu

    Ubuntu is the open source cloud OS, supported by Canonical.

  • Pivotal

    Redefining PaaS for enterprise, leveraging big fast data.

  • Rackspace

    The open cloud company and OpenStack co-founder

  • HP

    To learn more about HP’s cloud solutions, visit hp.com/go/cloudtalk

  • AWS

    Pay-as-you-use cloud computing services for everyone

  • General Catalyst

    Funds breakthrough ventures and backs exceptional entrepreneurs.

  • Aruba Networks

    Aruba provides next-gen network solutions for the mobile enterprise.

  • Riverbed Stingray

    Riverbed Stingray: Fast, reliable, secure applications in the cloud

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Katie

I'm surprised by the level of growth I've seen since becoming an organizer, it's given me more confidence in my abilities.

Katie, started NYC ICO

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy