addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

San Francisco Hadoop Users Message Board › Mar 2011 - S4 and Flume for streaming data

Mar 2011 - S4 and Flume for streaming data

A former member
Post #: 7
Highest-level differences: S4 is a processing-level system, Flume is more designed for transport

Flume's focus is on reliable transport from end-to-end.
S4 provides a Java API for arbitrary stream processing.

S4 uses UDP for load-shedding; Flume uses acks to ensure delivery of events.

Aaron has a project available "soon" that provides some SQL-like features on top of Flume, so stay tuned.

Powered by mvnForum

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy