Intro to Lambda Architectures & Development

Note: Date targeted at mid-to-late September, will solidify in the next week.

Who cares about Lambda architectures? Anyone who as process both event streaming data AND batch data in a scalable fashion.

Lambda architectures are everywhere and seem to be in the vogue. As an architecture, it is a stepping stone on the way to the future Hadoop platform that handles ingest, ETL, and analytics in both a batch and event-driven scenarios all in the same technology stack. We'll take a look at what scenarios you would consider Lambda architecture as well as common Lambda architecture components including:

• Speed Layer
• Batch Layer
• Queue
• Reprocessing

There are many options in Hadoop to craft Lambda Architectures, we will look at some of the more common technology components, especially those with friendlier development experiences:

• Kafka & Storm this evening

Note: will split into another joint session for Spark Streaming