addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

MapReduce - When to use it, when to avoid it.

May Sydney GTUG - MapReduce

Update : A code-lab will follow the talk so if you want some hands-on then bring your laptop prep'd as described below.

Speaker : Adam Horvath

If you have heard of MapReduce and wondered what it is or how you can use it then come along and hear about Adam's experience.

You will hear about :

  • What is MapReduce ?
  • What is it good for, when to avoid ?
  • Some real world examples (with code demos) to show how easy it is to process the data you already have (log parsing, trend analysis, product recommendation based on user visits, etc).
  • The whole idea is to show how short the learning curve can be and how easy it is to go to production with your custom data processing.

CODE LAB

We are planning to have a hands-on lab after the presentation. If you want to get your hands dirty, please download and install the following free tools before the presentation:


On Windows Microsoft.NET framework, Visual Studio or the free Visual Studio Express C# (http://www.microsoft.com/visualstudio/en-us/products/2010-editions/visual-csharp-express)
On other systems Mono framework SDK (http://www.go-mono.com/mono-downloads/download.html) MonoDevelop or your favourite source code editor tool (http://monodevelop.com/Download)

Join or login to comment.

  • Nik Y.

    Good introduction to MapReduce, however it was a little unclear how MapReduce was of benefit to solving the example problems (compared to solving them without the MR abstraction). I would have liked further discussion on how to subdivide problems into chunks that MapReduce can handle in parallel (the examples provided all seemed to assume a single thread). And then details about the performance of such parallelized MapReduce flows.

    May 24, 2012

  • A former member
    A former member

    Nice presentation. Would have loved it even more if the workshop wasn't .NET based.

    May 24, 2012

  • martin h.

    One of the best meetups, and left me wanting to know more.

    May 24, 2012

  • Ross L.

    Great and well prepared talk, thanks Adam!

    May 24, 2012

  • A former member
    A former member

    The talk was good but the title was a little misleading, as it was more an introduction to MapReduce concepts rather than an in-depth discussion of its pros and cons.

    May 24, 2012

  • A former member
    A former member

    The presentation was reasonably good, however the title did not match the content well. I was expecting a more in-depth exploration of the problems spaces thes MR was good/not-good for

    May 24, 2012

  • A former member
    A former member

    I got a good idea of waht MapReduce is and what it isn't. (I thought MapReduce was a feature of NoSQL databases, but infact it isn't really that at all.) Adam used a good choice of sample applications that make you understand the potential of this tool to solve problems given relatively 'crappy' input data like a web log and producing great information from this using Map-Reduce queries. My recommendation if he does this again is to go slower through some of the content. Perhaps that means having less content in total. There was a lot of information covered quickly in giant slides, and for a newbie to the subject it was hard to follow. I guess I had to accept that I wouldn't understand everything in one lecture but would get a good general idea.

    In any case, this was an interesting talk and it made me leave thinking I could rewrite Google search on my desktop PC :-). Well ... maybe.

    May 24, 2012

  • Push B.

    It was imply awsome. I hope to see more of these workshop! any idea when is the next one?

    May 23, 2012

  • JimN

    I good talk but I left with more questions about how map reduce is working under the framework, I think more could have been covered in that respect particularly regarding the scheduling. Without this knowledge the slides about optimisation just felt premature. Thanks Adam.

    May 23, 2012

  • Anthony

    Some URLs that might be useful: http://slidesha.re/mapreduce-intro for the slides, and http://bit.ly/mapreduce-intro-lab for the lab notes.

    And to answer John's question, Adam's talk was a good intro to MapReduce - I'm looking forward to delving a bit more into some of the technologies (incl. MapReduce for .NET :) )!

    May 23, 2012

  • A former member
    A former member

    I also got a lot from the talk.

    May 23, 2012

  • Andrew K.

    A great talk which was well presented, I noticed a few typos on the slides which Adam may want to fix up, but a good introduction to MapReduce. If the code lab after had been in java and not .Net I would have like to have stayed for that.

    May 23, 2012

  • John S.

    What did everyone think about the talk ? I would like to give some feedback to Adam. Praise, criticism, comments are welcome.

    May 23, 2012

  • Deepak K.

    Will the slides be posted online? I'm keen on getting those Urls on the last slide.

    May 23, 2012

  • A former member
    A former member

    6 PM is good for us that are faced with a two hour commute.

    May 23, 2012

  • mikemd

    I really wanted to go to this!!
    ... but could not get away from work early enough!

    please consider that not ev hour traffic lworks withing walking distance (I work at St Peters and though not really far time given that I wasn't able to leave work till pretty close to 6pm! - a start time only an hour later could have made all the difference!

    Now wondering where I can find nice info and examples of the concepts? .

    1 · May 23, 2012

Our Sponsors

  • Ausdroid

    Ausdroid is covering our meetup.com costs to help us serve you better.

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy