Bay Area Hadoop User Group (HUG) July Meetup

July 2011 HUG Agenda:

6:00 - 6:30 - Socialize over food and beer(s)
6:30 - 7:00 - Mellanox Hadoop-Direct Solution
7:00 - 7:30 - HA Namenode

Mellanox UDA Solution: With Mellanox UDA, an open source software plugin, accelerates Hadoop network and improves the scaling of Hadoop clusters executing data analytics intensive applications. A novel data shuffling protocol is provided for Hadoop to take advantage of RDMA from network technologies of InfiniBand and RoCE (RDMA over Converged Ethernet). UDA is RDMA based software plugin which combined with MLNX Linux inbox driver and Connect-X VPI hardware will accelerate tasks associated with Map/Reduce file transfer. UDA more than doubles the data processing throughput and reduces CPU utilization by half of Hadoop nodes.
Presenter: Dror Goldenberg, Mellanox

HA Namenode: The HDFS NameNode is a robust and reliable service as seen in practice in production at Yahoo and Facebook. However, the NameNode does not have automatic failover. A hot failover solution called HA NameNode is under active development (HDFS-1623). The design is fairly general providing a common framework and components allowing a variety of solutions. The project is a community collaboration. We describe our approach, design and current status.
Presenter: Sanjay Radia and Suresh Srinivas, Hortonworks

Yahoo Campus Map:

Detail map (http://photos4.meetupstatic.com/photos/event/2/8/e/d/600_21370477.jpeg)

Location on Wikimapia:

http://www.wikimapia.org/#lat=37.4181633&lon=-122.0250607&z=18&l=0&m=b&search=yahoo