Building a scalable IoT end to end data collection system: a Real-World Use Case
Details
In this meetup, we’ll demonstrate the creation of a system based on open source technologies that is able to pull data from a source, transform it, enrich it (if needed), store it, and make it available for query. Through the process, we’ll show a framework similar to one companies are already using at the enterprise level, scaling to thousands of data sources and terabytes of data. We’ll go over the use of NiFi for our data flow, Kafka to bring in the ability for streaming data, and HBase/Phoenix as our data store and operational database solution, all within the Cloudera Data Platform.
Come join us to see how we’ve linked all these concepts together and hopefully inspire similar solutions of your own!
For a preview of the content we'll be covering, we've got the following resources:
Video:
https://youtu.be/TmdROpjVtM4
Blog:
https://blog.cloudera.com/building-a-scalable-process-using-nifi-kafka-and-hbase-on-cdp
Cloudera Users Page:
https://www.cloudera.com/users.html
This will be an online event, the zoom link will be sent upon registration.
Building a scalable IoT end to end data collection system: a Real-World Use Case