Apache Kafka, Nifi, Bold BI to build a real-time data pipeline


Details
Agenda:
6.30 PM - Apache Kafka & Nifi
7.30 PM - Real-time use cases of Kafka
8.00 PM - Demo 1
8.15 PM - Demo 2
8.30 PM - Networking Tea & Snacks
-
A quick overview of how events role plays in the Big Data world via Apache Kafka and Nifi.
-
Discuss Kafka usage for real-time features in apps like Hotstar, Uber.
-
Demo - 1: Setup Apache Kafka in the Windows machine
a. Configure Kafka cluster components - Broker, Producer, Consumer.
b. Understand how Push and Pull messages happen between Topic in a Kafka cluster. -
Demo - 2: Real-time data pipeline demo,
a. Stream raw data into Apache Kafka.
b. From Kafka, stream the data into the Data Integration tool - Nifi for processing.
c. Store the processed data into the Azure SQL database.
d. Visualize and get insights about processed data in Bold BI.
About the speaker:
Dinesh Kumar - Product Manager for Dashboard Analytics @ Syncfusion Software. Being Technology Optimist, coming through 7+ years of work around data, he is deeply involved along with a great team to design and implement installable and B2B SaaS products all around the data stack - Big Data, ETL and BI. Currently, he is into Growth Hacking for the business intelligence tool - Bold BI.

Apache Kafka, Nifi, Bold BI to build a real-time data pipeline