Location: Google's Sydney office, Level 5, 48 Pirrama Road, Pyrmont
6pm for a 6.30 start. Please be prompt as it can be difficult to get in the building after 6.30pm
Two great talks in one night to kick us off. Big thanks to Google for providing the venue, and to Cloudera for putting down a tab at the bar afterwards. See you there!
Talk: Taking the pain out of MapReduce with Hive and Pig (Ian Wrigley, Cloudera)
Writing Hadoop MapReduce jobs in Java can be a complex, time-consuming task. That's great for job security, but not for productivity. In this talk, we'll discuss Hive and Pig, two high-level abstractions which make the power of Hadoop accessible to a far wider audience. We'll see what sort of data lends itself to being processed by these languages, and what types of problems still need you to bribe the resident Java expert.
Talk: Intro to AppEngine (Nick Johnson, Google)
Nick will give an overview of App Engine, a complete hosted runtime environment for Java and Python applications that automatically scales on top of Google's own infrastructure. As well as offering a durable and highly scalable data storage on top of BigTable, AppEngine also provides built-in APIs for task queuing and toolkits for data transforms.
Following the talks, we'll keep the talk going at the Pyrmont Bridge Hotel, with a bar tab for early birds (thanks Cloudera!).
About the Speakers
Ian Wrigley started one of the UK's first web consultancies and has been managing large amounts
of data ever since, starting with flat files and Perl scripts, moving on to database servers such as MySQL, and now Hadoop. He describes his job as Cloudera as "helping geeks become geekier". Ian is also PC Pro's Contributing Editor for Unix and Open Source. Cloudera are the "Commerical Hadoop" company that provide their own open source Hadoop distribution as well as management tools and production support for the enterprise.
Nick Johnson is a Developer Programs engineer for Google App Engine, who's recently seen the light and moved to Sydney. His blog (http://blog.notdot.ne...) is an essential resource to almost anyone building for Google App Engine, and when he's not saving the world there he can be found on twitter (@nicksdjohnson) or Stack Overflow helping folks out. It is rumoured that he owns a Python.