Skip to content

Keeping cool under pressure with Apache NiFi

Photo of Rommel Garcia
Hosted By
Rommel G.
Keeping cool under pressure with Apache NiFi

Details

Note: Moving event to the 28th because of venue availability. Abstract:
In this age of “big data” the datacenter has grown increasingly chaotic. Gone are the days of monolithic systems with their stringent input and output. Todays datacenter is a buzz with distributed systems and new data sources. These new data sources range from structured data sets to loosely defined (or not defined at all) multimedia data. Whether analyzing these data sources in real time or aggregating to a Hadoop data lake Apache NiFi can help keep you cool under the pressure with features like a HTML5 UI for drag/drop workflow design, a large library of built in processors, a mature codebase (contributed by the NSA), data provenance, persistent flows, and the flexibility to implement your own custom processor logic.

General Presentation Info:
I plan to speak about overall NiFi architecture, best practices, and present a demo incorporating built in and custom processors to detect faces from images as they flow through NiFi. Knowledge of all other technologies that will be included in the demo are certainly not required to get value from this meet up. Having those technologies just helps to illustrate the point of NiFi working well with several other systems acting as the “glue” if you must.

Bio:
Jeremy Dyer is a Solutions Engineer at Hortonworks and contributor to Apache NiFi. He has been involved with the Hadoop ecosystem since 2009 working in the application development space. Jeremy’s background includes Java/C/Python/Node.js system development, IoT devices, IOS and Android mobile development, modern web development, and the complete Hadoop ecosystem. When not geeking out on tech Jeremy passes his time with woodworking, snow skiing, hiking, playing hammerschlagen (https://en.wikipedia.org/wiki/Hammerschlagen), and hanging out with friends. Jeremy lives in Atlanta with his loving wife Carla and their awesome dog Zeke.

Photo of Big Data ATL group
Big Data ATL
See more events