Hadoop Ecosystem Working Meeting -- Integration Testing, porting Hama to Bigtop

The IntelliJ licenses have been distributed to registered members as of 1/27...

This is a working group meeting for Java Programmers interested in becoming Apache Bigtop Committers with corporate support/donations from MSFT, Amazon, Jetbrains, and Cloudera. The focus is on learning how to write cloud code using Hadoop, Hive, Flume, Sqoop, HBase, Mahout and Hama.

Members on the confirmed sign up list have been sent MSFT Hadoop Azure codes and AWS codes as of 1/11/12 for free cluster time, sponsored by MSFT and Amazon.

Roman from Cloudera available for questions.

This is not a class. This is a working group meeting where you can see what others have done, code they have written, and how other programmers go about deconstructing complicated pieces of s/w. This is a self paced format where each member works at their own pace. The material presented here is equivalent to what you would be getting if you joined as a new employee at Cloudera. Members show Demos of Bigtop install, Bigtop build, Bigtop Integration testing in Groovy & Java, writing code using Hadoop, Hive, Flume, Sqoop, HBase, Mahout, and Hama components.

Puppet review once material is ready.

The purpose of these working group meetings is to train Java Programmers how to contribute to first Apache Bigtop (incubating) and then other Hadoop ecosystem components.

BigTop is a software framework Cloudera open sourced which is used to build, deploy and validate Hadoop distributions (Bigdata stack currently consisting of Hadoop, Hive, Flume, Sqoop, HBase, Mahout into RPM and DEB packages).

This is a good starter project if you are interested in getting hands on programming experience in Hadoop without having to become a Map Reduce or Distributed Computing expert first.

So far we have shown how to do an install, Apache Jira ticket workflow, Jenkins build systems for Hadoop/Cloudera, system/integration test creation and execution against a pseudo-distributed cluster.

Week 11(3/10/12) Integration Testing, Hama Development

Guest lectures to come....

See what progress you can make after the installation of bigtop. Follow the directions on the README and debug.

Biocurious membership required for attendees on the second visit. First visit is free per Biocurious space policy. Membership required on second meet up. Per Biocurious website policy for using the space. This is not a charge collected by this meetup group or any individual, contributor or particpant in this group either in full or any fraction thereof. Please join on the Biocurious website.

http://apachebigtop.p.... (http://apachebigtop.pbworks.com/w/page/48434924/FrontPage)