Real-Time Big Data Analytics with Apache Kafka Streams with Allen Underwood

We will meet virtually Tuesday, June 9th.

Real-Time Big Data Analytics with Apache Kafka Streams

As companies generate and store increasing amounts of data, using and distributing that data can quickly become a challenge. The saying is "knowledge is power" and extracting knowledge from our data is the new norm. As the volume of data increases and the number of sources where we gather our data also grows, the standard ETL processes we've used for the past several decades are starting to break down in terms of their effectiveness and timeliness.

In this talk we'll review the standard batch ETL processes most people are familiar with, and then we'll step into the world of streaming data where we'll start processing data in real-time leveraging Apache Kafka as the shared backbone for connecting our streaming data with SQL Server and ElasticSearch. We'll be demonstrating real-time data aggregations and horizontal scaling using a combination of Kafka, Kafka Connect, KSQL and Kafka Streams.

If you're curious what it might be like to live in a world where you're not waiting for your batch processes to complete and you'd rather have instant access to your processed data as it comes in, come join us in the evolution of ETL.

Allen Underwood

Allen Underwood is a co-host of one of the top software development podcasts, CodingBlocks.NET, a Principal Software Engineer with Broadcom, and a Microsoft MVP. He is a full stack developer who enjoys problem solving, big data, architecture, learning, teaching and sharing every step of the way. He is married to an amazing woman, has three incredible children. Beyond family and software, he also enjoys American football, basketball, and just about anything competitive!

Watch the live stream on Twitch! (https://www.twitch.tv/stpetedotnet)

Join our Facebook group (https://www.facebook.com/groups/StPeteDotNET/)

Follow @StPeteDotNET ( https://twitter.com/stpetedotnet ) on Twitter!

Subscribe to our YouTube channel ( https://www.youtube.com/channel/UC_kdG2Reanc7Bo3K0XOYZ-g ).