YARN / MapReduce 2

Abstract:

Apache Hadoop 2 includes a new MapReduce engine, which has a number of advantages over the previous implementation, including better scalability and resource utilization. The new implementation is built on a general resource management system for running distributed applications called YARN. In this talk Tom will walk through the new architecture and compare and contrast MapReduce 2 running on YARN with the architecture of MapReduce 1.

Bio:

Tom White is one of the foremost experts on Hadoop. He has been an Apache Hadoop committer since February 2007, and is a member of the Apache Software Foundation. His book Hadoop: The Definitive Guide (O'Reilly) is recognized as the leading reference on the subject. In 2011, Whirr, the project he founded to run Hadoop and other distributed systems in the cloud, became a top-level Apache project.

Tom is a software engineer at Cloudera, where he has worked since its foundation, on the core distributions from Cloudera and Apache. Previously he was an independent Hadoop consultant, working with companies to set up, use, and extend Hadoop. He has written numerous articles for O'Reilly, java.net and IBM's developerWorks, and has spoken at several conferences, most recently at ApacheCon and OSCON in 2011. Tom has a Bachelor's degree in Mathematics from the University of Cambridge and a Master's in Philosophy of Science from the University of Leeds, UK.

Join or login to comment.

  • Andrew R K.

    Presentation - https://dl.dropbox.com/u/3289117/nyhadoop/yarn_mr2/yarn_mr2_nyhadoop.pdf
    Working with g33ktalk.com to sync the audio. We'll get that up on slideshare or something soon.

    August 3, 2012

  • Reginald D.

    It was very informative, the guest speaker did a good job and I'm glad I attended.

    August 2, 2012

  • Jesse W.

    Great presentation. Thanks again, Andrew and Tom.

    August 2, 2012

  • John M.

    I love Tom's talk. Will the presentation deck be available for us to download?

    August 2, 2012

    • Andrew R K.

      Yes John. I'll post the slides today.

      August 2, 2012

  • John M.

    I really loved the talk. Will the presentation deck be available for us to download.

    August 2, 2012

  • Vijay T.

    As a newbie to Hadoop/Big data, I was happy to be able to grasp the concepts that Tom WHite talked about. Great talk.

    August 2, 2012

  • Matthew L.

    I'd love to attend if a spot opens up

    July 30, 2012

  • Andrew R K.

    For those members who have registered but whose name in meetup does not include a full name, please update your profile or send me your name in a PM. Building security needs full names to create passes. You will not be able to enter the building having registered as "John."

    July 30, 2012

  • Andrew R K.

    Sorry, we're capped at the 70 person limit and need to register the names in advance, so a waiting list wasn't added.

    July 30, 2012

  • Raphael A.

    Is there a waiting list?

    July 28, 2012

  • Stan R.

    Didn't get a chance to rsvp in time; is there going to be a waiting list?

    July 27, 2012

  • Andrew R K.

    I've already heard from Pete at g33ktalk.com. They'll be recording audio. We'll also try to capture the presentation and/or get slides.

    July 27, 2012

  • A former member
    A former member

    Small chance I won't be able to make it--is there any chance this gets recorded?

    July 27, 2012

Our Sponsors

People in this
Meetup are also in:

Imagine having a community behind you

Get started Learn more
Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy