MongoDB and Hadoop

Hey Alex Piggott has offered to share his experiences working with Hadoop backed by MongoDB with the hadoop adaptor.  For more information on the adaptor see here http://api.mongodb.org/hadoop/MongoDB%2BHadoop+Connector.html

Alex has put together a very interesting technical blog post at http://www.ikanow.com/blog/02/15/how-well-does-mongodb-integrate-with-hadoop/ For anyone who is interested in reading ahead.


Join or login to comment.

  • Rich B.

    Thanks to Alex and the Douglas & Proteus team for sponsering this. It's interesting to how Mongo plays in the analytic/OLAP world. Question: does anyone have a post/URL that compares MongoDB vs. traditional-structured/sql-databases-RDBMS? Key question that most folks don't always answer: from a technical perspective what are the features that compel you to choose structured-RDBMS over NoSQL? Seems ACID (e.g., bank transaction) is a good example of where RDBMS shines, but are there other use-cases and examples where NoSQL is maybe not the best fit?

    As per our conversations near the end, it seems Mongo is great for web-apps that do both read/writes. Correct me if I'm wrong, but guessing most of those web apps in production are more transactional oriented (online-OTLP) and not so much reporting/analytic (OLAP).

    Most apps (esp web apps) are "read heavy" unless you're doing ETL/batch-loads, batch inserts. Most reporting/analytic are especially read heavy.

    February 27, 2013

    • Alex P.

      There's about a million RDBS-vs-NoSQLxxx-vs-Mong­oDB posts, but unfortunately I'm not aware of one that is "authoritative"­, they mostly have an agenda or look at one specific aspect.

      February 27, 2013

    • Alex P.

      My rule of thumb would be that if you don't think you're going to need to scale and have a transactional component then RDBMS is safest (even though all the major NoSQL platforms have a transactional story) ... then there's a big grey area in the middle before you get to scenarios where you can decouple reading and writing in which NoSQL is definitely better; and then in that envelope, for smaller scales MongoDB is a no-brainer because it's so much easier to use; as the scale increases it becomes more a function of what you're trying to achieve vs the feature sets/community focus. FWIW looking around, it seems that NoSQL vs OLAP is something of a holy war where OLAP side says "you can't do <X> using NoSQL" and NoSQL side says "well actually you should be doing it differently anyway". There's no doubt that relational OLAP is much more mature than relation NoSQL of course.

      February 27, 2013

  • BioITBob

    Sorry -- Something blew up last minute. Was looking forward to it too. Doh!

    February 26, 2013

  • Max M.

    Have to cancel... Fixing these server issues will take me more than 10 minutes :(

    February 26, 2013

  • A former member
    A former member

    Sorry -- I'm not sure I'll be able to make it after all, so I think I'll say no for now so that others can use my seat.

    February 25, 2013

  • Alex P.

    I think someone moved my blog post! ... it's now at http://www.ikanow.com/blog/02/15/how-well-does-mongodb-integrate-with-hadoop/

    Sorry about that!

    February 18, 2013

  • Rich B.

    Looking forward to it. Great location & time.

    February 16, 2013

  • vincent y.

    out of town

    January 17, 2013

28 went

Our Sponsors

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy