Skip to content

Apache Kafka, Nifi, Bold BI to build a real-time data pipeline

Photo of Dinesh Kumar P
Hosted By
Dinesh Kumar P. and 2 others
Apache Kafka, Nifi, Bold BI to build a real-time data pipeline

Details

Agenda:

6.30 PM - Apache Kafka & Nifi
7.30 PM - Real-time use cases of Kafka
8.00 PM - Demo 1
8.15 PM - Demo 2
8.30 PM - Networking Tea & Snacks

  1. A quick overview of how events role plays in the Big Data world via Apache Kafka and Nifi.

  2. Discuss Kafka usage for real-time features in apps like Hotstar, Uber.

  3. Demo - 1: Setup Apache Kafka in the Windows machine
    a. Configure Kafka cluster components - Broker, Producer, Consumer.
    b. Understand how Push and Pull messages happen between Topic in a Kafka cluster.

  4. Demo - 2: Real-time data pipeline demo,
    a. Stream raw data into Apache Kafka.
    b. From Kafka, stream the data into the Data Integration tool - Nifi for processing.
    c. Store the processed data into the Azure SQL database.
    d. Visualize and get insights about processed data in Bold BI.

About the speaker:

Dinesh Kumar - Product Manager for Dashboard Analytics @ Syncfusion Software. Being Technology Optimist, coming through 7+ years of work around data, he is deeply involved along with a great team to design and implement installable and B2B SaaS products all around the data stack - Big Data, ETL and BI. Currently, he is into Growth Hacking for the business intelligence tool - Bold BI.

Photo of Makers Tribe group
Makers Tribe
See more events