DOSUG Meeting

DOSUG welcomes Joe McTee of Tendril, who will talk to us about Hadoop.

By now, if you have any interest in Hadoop, you have seen the 'Hello World' of Map-Reduce, the word count app. In this info-dense talk, Joe will go beyond this simple example and show how other tools in the Hadoop infrastructure work by developing a more interesting (but still contrived!) application that monitors solar power generation and compares it to temperature and cloud cover.

Time allowing, we will cover accessing HDFS from the command line and programmatically via Java, Sqoop to import data from an RDBMS, Pig (a data flow DSL), Map-Reduce, Hive (SQL-like data query DSL), and orchestrate all the pieces with the Oozie workflow tool.