Hadoop Ops

Pizza, beer, and mingling.

Lightning Talks:

"Tracking multi-tenant resource usage with 'White Elephant'"
Adam Faris (http://www.linkedin.com/pub/adam-faris/1/9a6/64a) - Senior Grid Operations System Engineer, LinkedIn "Managing and Provisioning Hadoop Clusters"
Darren Lo (http://www.linkedin.com/pub/darren-lo/14/7b6/4a5) - Software Engineer, Cloudera

"How Klout migrated from CDH3 to CDH4"
Ian Kallen (http://www.linkedin.com/in/spidaman) - Lead Ops Engineer, Klout

"Challenges and Capabilities in Managing a MapR Cluster"
David Tucker (http://www.linkedin.com/in/dbtucker) - Solutions Architect, MapR Technologies

"Hadoop Cluster Management with Apache Ambari"
Sumit Mohanty (http://www.linkedin.com/pub/sumit-mohanty/0/2b4/8a) - Member of Technical Staff @Hortonworks & Apache Ambari PMC Member/Committer

There's certainy a lot of interest in using Hadoop, as there are meetups, classes, and tutorials on writing Map-Reduce (http://en.wikipedia.org/wiki/Map_reduce) jobs. But there isn't too much discussion on how to manage Hadoop clusters.

If you're using Hadoop in production, how do you manage it? Does the distribution you're using provide any tools to make the job easier? What are the pitfalls? Are there parts of the system that are less robust or that have problems more often? Are you running Hadoop on bare metal, or in a cloud environment, and is one easier than the other? Are you using a managed solution such as AWS' Elastic Map Reduce, and if so, what does that bring to the table as far as operations goes?

For our September event, I'd like to hear about issues and solutions in managing a Hadoop deployment. I'm looking for 2-4 20-25 minute talks. If you can give a talk, please contact me, Chris Westin, through meetup.

As well as the evening's theme talks, we can fit in 2-3 five minute lightning talks at the beginning of the evening; any topic that would be interesting to the #lspe audience is welcome. If you're interested in giving a lightning talk, contact me, Chris Westin, through meetup.