Data Ingestion with Apache NiFi

Hi together,

our next meetup will dive into the details of an exciting new Apache framework for data ingestion. The project, which was originally created by the NSA as Niagara Files, is now driven by HortonWorks. Hence, Peter Greiff, a technical specialist from HortonWorks, will share with us use cases and technical details of NiFi and how it all fits into the Hadoop environment.

The location for the meetup is still to be defined. If anybody would like to host the event at his/her company, please let me know. Otherwise it will again be either at the TH Nürnberg or at Ancud IT.

About the Talk:

Massive data streams that originate from connected yet disparate sources including sensors, machines, geo-location devices, social feeds, web clicks, server logs and more, are forming the Internet of Anything (IoAT). This new data paradigm is driving the need for trusted insights from data at the very edge to the data lake and in real-time with full fidelity and security. Hadoop offers a strong feature set to analyse this data but how are you able to quickly, securely and trustfully ingest the dynamically changing data stream generated by IoAT?

Systems must be able to ingest and process this information in a timely fashion – before its value perishes. Join us to learn how Hortonworks Data Flow (HDF), powered by Apache Nifi, enables organizations to harness IoAT data streams to drive business and operational insights. In this session we will provide an overview of HDF, including detailed hands-on demo of how to build HDF pipelines for capture and analysis of streaming data and give an outlook what will come with the next iteration of the product.

Prerequisites: none.

About the Speaker:

Peter Greiff works in the Solution Engineering team of Hortonworks and is specialised on connecting and automating processes across IT silos, IoT, Data Ingestion and Big Data. In his role he helps companies to unterstand how the capabilities of the Hortonworks Connected Data Platform could help them to solve todays challenges in above named use cases. Before Peter joined Hortonworks, he was working 10 years for TIBCO as a Principle Solution Consultant helping companies to move from a batch based IT into the world of SOA and MicroServices, and reacting on situations using CEP and Event Stream Processing for real-time Analytics.