Moving data gracefully with Apache NiFi

Speaker: Adam Lamar (https://www.meetup.com/messages/?convo_id=307207475271503872&_xtd=gatlbWFpbF9jbGlja9oAJDAxMWE3MTM5LWQyZjMtNDBjZi1hN2ExLWM5Mjg0MDYwNWEwYQ)

Have you ever wanted to automatically move files between two servers, and how did you solve that problem? Shell script invoked via a cronjob?

Apache NiFi (https://nifi.apache.org (https://nifi.apache.org/)) is dataflow system designed to move data gracefully. Modern applications use a dizzying number of data sources and databases to accomplish their work. Whether your data is stored in Amazon S3, a traditional RDBMS, your favorite NoSQL data store, inside Hadoop's HDFS, or just sitting on your local filesystem, Apache NiFi can probably move, transform, or forward it wherever you like, all while providing features your shell script probably forgot: a web-based administrative interface, real-time statistics, queuing and retries, the ability to instantly modify data movement, distributed processing across a cluster of nodes, and a powerful provenance (auditing) feature.

In this hands-on talk, I'll provide an overview of basic Apache NiFi functionality, build a couple common use cases from scratch, and selfishly show off some of my own recent contributions to the project.

Location is TBD, will post a location about 1 week before the event