Bay Area Hadoop User Group (HUG) September Meetup

Sep 2011 HUG Agenda:

  • 6:00 - 6:30 - Socialize over food and beer(s)
  • 6:30 - 7:00 - Architecture of an Enterprise MapReduce Engine for Hadoop Deployments
  • 7:00 - 7:30 - Gateway: Cluster Virtualization Framework
  • 7:30 - 8:00 - Apache Sqoop - A Data Transfer Tool for Hadoop

Architecture of an Enterprise MapReduce Engine for Hadoop Deployments: Enterprise customers expect a solution that is easy to deploy and manage, integrates with IT security and management tools, guarantees high reliability and availability, and supports multiple lines of business and applications as well as multiple distributed file systems.

In this talk we will explore the architecture of the Platform MapReduce distributed runtime engine, which is capable of achieving these enterprise-class needs today.

Presenter: Scott Campbell, Platform

Gateway: Cluster Virtualization Framework: Access to Hadoop clusters in production environment is restricted by corporate firewalls. Users access Hadoop clusters via dedicated portal nodes. Portals located behind firewalls perform user authentication and authorization. On clusters with many users portals become shared multitenant resources, which create contention among users and increase maintenance overhead for administrators.
We present the Gateway Project developed at eBay. Gateway is a cluster virtualization framework, which provides
1. Seamless access to multiple clusters from users’ workplace computers through corporate firewalls.
2. Service availability: failover to active clusters when one has scheduled/unscheduled downtime.
3. Flexible cluster upgrades: redirect traffic to other clusters when one is upgrading.
4. Versioning: access to clusters running different versions of Hadoop.
Presenter: Konstantin V. Shvachko, eBay

Apache Sqoop - A Data Transfer Tool for Hadoop: Apache Sqoop is a tool designed for efficiently transferring bulk data
between Hadoop and structured datastores such as relational databases.This talk aims at familiarizing the user with Sqoop and how to effectively use it in real deployments.

Presenter: Arvind, Cloudera

Yahoo Campus Map:

Detail map

Location on Wikimapia:[masked]&lon=[masked]&z=18&l=0&m=b&search=yahoo

Join or login to comment.

  • Shanti S.

    The Platform presentation was well delivered but the other two had little meat and were too slow

    September 22, 2011

  • Sanjay G.

    Some good infrastructure/management talks.

    September 22, 2011

  • K Ramesh Babu, C.

    The content was very appropriate for Hadoop practitioners, but nor for newbies.

    September 22, 2011

  • A former member
    A former member


    September 22, 2011

  • A former member
    A former member

    I'm new to the group. What are you guys covering?

    September 7, 2011

Our Sponsors

  • Yahoo! Inc.

    Meeting space, pizza and drinks are sponsored by the Yahoo! Hadoop team.

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy