Collaborative Meetup with DC Hadoop User Group

NCAGTUG is set to hold our next meetup on September 7, 2010 with Washington DC Area - Hadoop User Group (HUG). "Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license.[1] It enables applications to work with thousands of nodes and petabytes of data. Hadoop was inspired by Google's MapReduce and Google File System (GFS) papers" -
Wikipedia More Info from Hadoop meetup group: . I'd like to thank our sponsors: Booz Allen Hamilton - Cloudera - This meetup is in coordination with several other meetup groups from the area. I'd personally like to thank them for working with us and helping to organize this event: DC useR Group - DC Python Meetup - The Washington Semantic Web Meetup - DC VA MD New Media Tech - Video - Social Web - National Capital Area Google Technology Users - I'm excited to say we have two very special guests presenting at this meetup, Tom White and Aaron Cordova. Tom has been instrumental in shaping the direction and development of Hadoop and many projects in Hadoop's ecosystem. He is also the author of the book "Hadoop: The Definitive Guide" and a part of the team at Cloudera. Aaron Cordova is a UMD graduate working at Booz Allen Hamilton. Before joining Booz Allen Aaron played a key role in defining the critical large scale data analytics infrastructure and applications at the NSA. Currently Aaron focuses on helping government organizations manage and analyze large amounts of data using technologies such as Hadoop, Hive, and HBase. Thus enabling them to make better decisions and answer key questions important to business and operations. Location: Kaiser Family Foundation - Public Affairs Center 1330 G St. NW Washington, DC 20005 1 block from the Metro Center Station metro stop. Agenda: 6:30 - 7:00 Food and Refreshments, Socialize 7:00 - 7:30 Tom White - Hadoop's powerful parallel processing paradigm provides a great generalized framework for storing and analyzing data. For all its raw power however the practical use of Hadoop requires more. What's needed is an integrated stack of components which makes it easier to develop and use real-world applications in a production environment. Tom will discuss the evolving Hadoop platform, its components and how each fills a critical role in making Hadoop more useful in the enterprise. 7:30 - 7:40 Short Break 7:40 - 8:10 Aaron Cordova - One of the barriers to scaling Hadoop to 10,000 machines is the single HDFS NameNode. Recent benchmarks [1] show that the HDFS needs to be able to do an order of magnitude more writes per second to reach 10,000. The most promising way to do this is to create a distributed NameNode. Aaron will discuss the issues surrounding distributing the NameNode functionality to multiple machines, including automatically and organically partitioning the namespace, how to keep operations serialized and durable, and how recovery from failure changes. 1. Shvachko, Konstantin. HDFS Scalability the Limits of Growth. USENIX Login Magazine. April 2010. Don't Forget: Registration is open for Cloudera's Hadoop World in NYC More information here:
http://www.cloudera.c.... Look forward to see you there!

Join or login to comment.

  • Dean W.

    Nice to listen to people working on really BIG problems. Can't say I'll ever have a problem that needs 10,000 nodes. Impressed with the effort and original work by the second speaker. Lively discussion. Schemaless seems the way to go, though BigTable or CouchDB attract me more at this point. FREE PIZZA.

    September 8, 2010

8 went

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy