Everything You've Always Wanted to Know About Big Data (but were afraid to ask)

Wikipedia's entry on Big Data begins:

“In information technology, big data is a loosely-defined term used to describe data sets so large and complex that they become awkward to work with using on-hand database management tools.”

This isn't a particularly satisfactory answer, and not simply because it is both self-referrential and vacuous.

Okay, maybe that is the reason. Regardless, everyone reading this deserves a more informative answer.

To that end, the talk will start off with a mercifully brief operational definition of Big Data. We will then look at a few examples that would appear to fit this definition, and why they are generally recognized as being “big data challenged” when “traditional database technology” is applied.

The bulk of the talk, then, will consist of a description, explanation and cross comparison of the three primary approaches to Big Data, namely:

1) Parallel, shared-nothing, (columnar), database clusters
2) Distributed key/value stores (nosql)
3) Map/Reduce (Hadoop) implementations

Questions will be welcome at any time during the talk. In fact, if you have any burning ones up front, you are welcome to submit them beforehand and, time permitting, they will addressed during the course of the talk.

Admittedly this is an ambitious agenda, but since the talk will be completely devoid of Powerpoint animations and sound effects, that extra time can be put to effective use.

 

Howie Rosenshine has spent more years in “the industry” than he cares to admit. He also has a Masters degree in Computer Science from Penn, where his interests were functional programming and databases. (This he is perfectly happy to admit.)

His formative years included working with device control and assembly language and Logic Programming/Knowledge Representation (Prolog).

He has spent the bulk of his career at Sun Microsystems (including, Oracle), where he was a Software Consultant (Unix/C) and a Systems Engineer. Sun was a wonderful place to work for many years; this included industries such as Wall Street/Finance, PharmChem and Defense (contractors and integrators). He spent the latter part of this time primarily in support of the Intelligence Community working for...oops, that was almost a no-no.

Howie is also the inventor of the Shovelution (shovelution.com), which is both patented and public. Other inventions include an optimal resistance exercise machine and a web search augmentation algorithm that one of his (very few) beta testers has dubbed “SBE” for Search by Example. These two are neither public nor patented...yet. It is true, of course, that neither the name “Search by Example” nor the concept is new, but this algorithm is notable in that it actually works.

Finally, Howie has a Black Belt in Bull Sigma, a paradigm invented by Nathan Myhrvold, that both corporations and individuals alike can use to effectively inflate their otherwise mediocre credentials and accomplishments.

Join or login to comment.

  • A former member
    A former member

    Michael
    Thanks for putting together last nights MeetUp. Howie seems like a seasoned individual, however his presentation skills are a little lacking.

    June 20, 2012

  • Lindsey S.

    It was good overall, and I'm glad I went. I wish we would have spent more time on NoSQL and mapreduce as opposed to non-shared rdb, but that's because I didn't realize there were 3 ways to handle so-called Big Data. We got a little off topic here and there so we spent less time on the NoSQL and mapreduce techniques than we should have.

    June 20, 2012

  • Howie R.

    Perhaps my opening comment needs a bit of context.

    When I visited the web page, it said something like: "Hey Howie, get this discussion rolling with a comment." I didn't realize that that statement was for my eyes only, or deleted upon first comment, or something like that.

    So I hope that puts it in a little better perspective.

    This may help too: http://snltranscripts.jt.org/75...­

    June 4, 2012

  • Howie R.

    You mean there wasn't enough in the overview and the "bio" to get things rolling? Tough crowd.

    Okay...how about this: Dead puppies. Comments?

    Okay, I admit it. I stole that from Buck Henry and Saturday Night Live.

    But in a similar vein, most of the information in the talk won't be particularly original. The idea is to take the information that does exist and try to distill it into a meaningful presentation.

    The ride may be bit bumpy, so please keep your seat belt fastened.

    June 1, 2012

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy