Sensor Data Ingestion and Processing with NiFi and Spark

Welcome to a new installment of the Future of Data Amsterdam meetup series! Speakers from KPN and Hortonworks will showcase what can be done with sensor data ingestion and data flow management. Presented the first time: a big data brainwave scanner!

Agenda:

18:00 - Arrive, drink, eat

18:45 - Presentations

1. Real-time insights and interactive visualizations from your brainwaves.

A common challenge we see at Hortonworks is how to generate real-time perishable insights on large volumes of streaming data from edge devices, and to explore and visualize this time-series data on interactive dashboards.

So what is a good way using the latest version of the Hortonworks stack with HDF & HDP to effectively deliver this use case?

In this demo presentation we'll generate time series data and show you how to use the Hortonworks stack to deliver this use case;

• Collect EEG (brainwaves) sensor data from Neurosky Mindwave headsets using Apache NIFI.

• Create perishable insights with Apache Storm on the streaming data in real-time.

• Perform historic analysis with Apache Zeppelin on time series data stored in Apache Hbase.

• Create real-time interactive dashboards to explore and visualize the enriched time series data.

Presenter: Ward Bekker, Hortonworks

2. To be announced

Presenter: Patrick de Vries, Architect, KPN

20:30 - Drinks and Networking

21:00 - Everybody out