Real-time, micro-batch, reactive programming with Kafka and Event Hubs

Before you can have Big Data, you must collect the data. There are two popular ways to do this: with batches and with live streams. Azure provides tools and services for streaming data into your Big Data pipeline in Azure using Event Hubs and Kafka. At this meetup, we will show you exactly how to do that.

Using these two features together, running VMs, clusters, and managing storage is all done for you. While this service is available in any cloud or on-premises system, we will show you how to use it in Azure. We will show you how to run a Kafka application to send and receive events to/from an Event Hub.

We will also show you how Azure Event Hubs enables real-time streaming and micro-batch processing, both on the same stream. There is no need to spin up a separate service or create multiple streaming pipelines. We will show how to do this with Event Grid, sending the data to a data warehouse. We will talk about how using this PaaS service makes it easy to gain valuable insights for your business while taking away the pains of managing it.

SPEAKER: Shubha Vijayasarathy, PM at Microsoft for Event Hubs. Please bring any Event Hubs questions you may have!