addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

San Francisco Hadoop Users Message Board › Apr 2011 - FlumeBase (Streaming SQL on Flume)

Apr 2011 - FlumeBase (Streaming SQL on Flume)

A former member
Post #: 13
In this session, I ran a demo of FlumeBase, a new open source streaming SQL system built on top of Flume.

Check it out: http://www.flumebase....­ and http://github.com/flu...­

Blog posts at http://blog.flumebase...­

* Integrates with running Flume deployment
* Currently supports parsing text and (some) Avro-based Flume messages
* Output is returned into Flume network
* Supports rolling aggregation, filtering, joins

We discussed what would be the most-useful new features to add. The short list of future work:
* HAVING clauses (filtered aggregates)
* JSON input
* Better scalability story: multi-threading, distribution of processing
* row-based aggregate ranges
* "chunking" (non-rolling aggregates)
* persistent metastore


Powered by mvnForum

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy