SMAQDown Sydney

SMAQ-talk #1 - Big Data with Little Effort

November 30, 2010 · 6:00 PM
This location is shown only to members

Location: Google's Sydney office, Level 5, 48 Pirrama Road, Pyrmont

6pm for a 6.30 start. Please be prompt as it can be difficult to get in the building after 6.30pm

Two great talks in one night to kick us off. Big thanks to Google for providing the venue, and to Cloudera for putting down a tab at the bar afterwards. See you there!

Talk: Taking the pain out of MapReduce with Hive and Pig (Ian Wrigley, Cloudera)

Writing Hadoop MapReduce jobs in Java can be a complex, time-consuming task. That's great for job security, but not for productivity. In this talk, we'll discuss Hive and Pig, two high-level abstractions which make the power of Hadoop accessible to a far wider audience. We'll see what sort of data lends itself to being processed by these languages, and what types of problems still need you to bribe the resident Java expert.

Talk: Intro to AppEngine (Nick Johnson, Google)

Nick will give an overview of App Engine, a complete hosted runtime environment for Java and Python applications that automatically scales on top of Google's own infrastructure. As well as offering a durable and highly scalable data storage on top of BigTable, AppEngine also provides built-in APIs for task queuing and toolkits for data transforms.

Following the talks, we'll keep the talk going at the Pyrmont Bridge Hotel, with a bar tab for early birds (thanks Cloudera!).

About the Speakers

Ian Wrigley started one of the UK's first web consultancies and has been managing large amounts
of data ever since, starting with flat files and Perl scripts, moving on to database servers such as MySQL, and now Hadoop. He describes his job as Cloudera as "helping geeks become geekier". Ian is also PC Pro's Contributing Editor for Unix and Open Source. Cloudera are the "Commerical Hadoop" company that provide their own open source Hadoop distribution as well as management tools and production support for the enterprise.

Nick Johnson is a Developer Programs engineer for Google App Engine, who's recently seen the light and moved to Sydney. His blog (http://blog.notdot.ne...) is an essential resource to almost anyone building for Google App Engine, and when he's not saving the world there he can be found on twitter (@nicksdjohnson) or Stack Overflow helping folks out. It is rumoured that he owns a Python.

Join or login to comment.

Harry Binnendijk

Very good turnup, very knowledgeable speakers and some beer to boost, excellent!

0 · December 2, 2010
A former member

Two well presented and interesting talks.

0 · December 1, 2010
A former member

Excellent and insightful talk n Hadoop!

The after-meetup drinks was also good

0 · December 1, 2010
Tim Savage

Interesting talks, interesting people, still a little hung over...

0 · December 1, 2010
Steve Buikhuizen

learned a lot. met interesting people

0 · December 1, 2010
Andrew

Fantastic night. Great speakers and an interesting crowd. Will definitely be up for the next one.

0 · December 1, 2010
Allen Hammock

Very interesting speakers, very topical!

0 · November 30, 2010
A former member

@tim either hassle me ([masked]), or hassle Nick on the night. =)

0 · November 18, 2010
Tim Savage

@Brett, Yep we are in the Fairfax Building across the park from Google.

0 · November 18, 2010
A former member

@tim Are you guys based at Pyrmont? I'm happy to wander next door and have a chat...

0 · November 18, 2010
Tim Savage

Likely there will be a group coming over from Fairfax Digital, have a few people interested here.

0 · November 18, 2010
Andrew

@Julian We'll see if we can sort out streaming on the night. That being said, the goal of the event is to get people meeting and talking face to face. Hope to see you there.

0 · November 18, 2010
Julian R A Manning

I would appreciate it if these talks were online. Julian

1 · November 18, 2010