How McGyver Learned to Leave Duct Tape Behind and Use Spark Instead

Title: How McGyver Learned to Leave Duct Tape Behind and Use Spark Instead (or How Orchestro Is Integrating Spark into its ETL Pipeline)

ABSTRACT
McGyver loved duct tape. From diffusing bombs to building ultralights, he never left home without it. If McGyver were a coder today, odds are Spark would be his digital duct tape. From replacing MR batch processing, to Spark SQL, to machine learning, to streaming, Spark covers the gamut. While there are a lot of exotic uses, this presentation focuses on one of Spark's fundamental use cases: ETL.

Whether the final resting place for your data is MongoDB or SQL Server, ETL is a must. This presentation will show just how impactful Spark can be with your existing ETL processes and that you don't have to do a full rewrite of your Stack to start taking advantage of it.

BIO
Jared Holmberg is a 15 year software veteran who remembers watching McGyver before the reruns and has fully embraced his inner geek. He's a sci-fi fan and can quote almost every line from the movie, Ghostbusters.

Jared works at Orchestro with an incredible team of talented engineers solving complex data challenges in retail and supply-chain analytics . When he's not filling out reports or going to meetings, he feeds his coding addiction with ample doses of Spark and Clojure. When he's not coding, he loves watching murderer mysteries with his wife or playing games with his two rambunctious boys.