addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1linklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

YARN:Overview,Tez:Fa­ster query processing on Hadoop-Siddharth Seth/Hortonworks

Apache Hadoop YARN - an overview
Apache Hadoop 2 went GA recently. This includes YARN, which allows additional applications other than MapReduce to run on a Hadoop cluster, by providing interfaces for cluster resource scheduling and application management.
The initial part of the presentation will talk about the YARN architecture and the advantages over Hadoop1 (JobTracker). It will also touch upon user requirements to migrate their MapReduce etc jobs from Hadoop1 to Hadoop2.

Apache Tez: taking Hadoop computation beyond MapReduce
Apache Tez is a distributed execution framework which allows for the execution of a complex DAG of tasks. This fits in well with Hive and PIG - which were otherwise forced to model their execution plans into multiple MapReduce jobs. This presentation will talk about what Tez is, the features it provides and what is coming. It will also cover some basics on how Hive is already making use of Tez to  improve query runtimes.

Bio: Siddharth Seth
Siddharth Seth works as a software engineer at Hortonwork, where he works on the Apache Tez project and the Apache Hadoop project – with a focus on YARN and MapReduce. He is a member of the Apache Tez PPMC and the Apache Hadoop PMC. Prior to this he spent several years working on search platforms and Oozie at Yahoo.

Bio: Xuan Gong
Xuan Gong work as a software Engineer at Hortonworks, where he focuses on Hadoop YARN and MapReduce. Prior to this, he spend one and half years working as a software engineer on big data processing at ADP. 

Join or login to comment.

  • Dave H.

    Very interesting. Exciting to see the direction these technologies are moving in.

    December 6, 2013

  • Mikhail K.

    Would be streaming and/or recording available?

    November 30, 2013

61 went

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy