C# Stream Processing with Apache Storm

Apache Storm (http://storm.apache.org) is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing. Storm is simple, can be used with any programming language, but we will focus on using C# and leveraging the Data Lake tools for Visual Studio.

Of course, we'll go through the obligatory introduction to the Storm architecture, but the real goal is to demystify this framework. We will do this by quickly turning to C# code. Live demonstrations of building a "spout" (the receiver of streaming data) and constructing custom "bolts" (the main processing stereotype) will be followed by crafting a topology (the realtime workflow) and submitting it for continuous execution.

We will view the executing workflow in the monitoring UI tools and then discuss advanced topics to include guaranteed processing of events and micro-batching. Attendees will be ready to develop Storm streaming applications by the end of this jump-start presentation.

Our speaker for tonight is Lester Martin. Lester is a 20+ year software development veteran with skills ranging from the mainframe, through Java and .NET distributed & web technologies, and for the last several years has been focusing on "big data" tools to include Hadoop and NoSQL technologies.

He is a system architect & technical trainer at Hortonworks and enjoys engaging in interactive discussions about these exciting technologies and open source in general. General information, social/community profiles and blog links can be found at https://about.me/lestermartin