Beyond Batch

The venerable MapReduce framework has allowed Hadoop to prove its worth in the big data space, and to store and analyze much larger data sets than was possible before. But there is a lot of activity in the big data ecosystem currently surrounding other major categories of workflows beyond batch.

These emerging tools include low latency i/o (HBase), interactive queries (Drill), stream processing (Storm), and text processing / indexing (Solr). This talk discusses some of the more interesting developments in Drill and Storm, their capabilities, and how they are being put to use in real world situations.

Brad Anderson has been wrangling data for 20 years, first with enterprise data warehouses and more recently building and using non-relational big data tools. Previously, he worked on a large-scale video-on-demand platform in Erlang, helped Cloudant build its hosted NoSQL offering based on CouchDB, and organized the NoSQL East 2009 conference in Atlanta. He has recently worked with Cascading, Storm and Neo4J, and has contributed code to the HBase open-source project. Brad has founded or co-founded four technology companies, and his first company operates today as Mirus Restaurant Solutions.

(Note that Brad's original Apache Drill talk had to be postponed due to weather. We're excited about this new, expanded version!)

Join or login to comment.

  • Mason S.

    Great learning more about Storm in particular

    January 16, 2013

  • Michael F.

    Knowledgeable presenter, however I would have appreciated a couple minutes spent explaining what Drill and Storm do at a high level, how they are positioned within the Hadoop ecosystem, and as such what problems they most adept at solving. I felt like we jumped into the nuances of Drill and Storm without an understanding of what problems these tools address. The presentation might have been better suited to a Hadoop-specific meetup, but I like PhillyDb because it gives me exposure to a breadth of different database technologies, tools, and techniques.

    January 16, 2013

  • Brian O.

    Rock on. We are heavy into Storm. Currently converting all of our topologies to Trident. (http://brianoneill.blogspot.com/2012/08/a-big-data-trifecta-storm-kafka-and.html) Looking forward to the presentation.

    January 12, 2013

Create a Meetup Group and meet new people

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy