Performance improvements to spark 2.0: 20x sql speedup techniques

Brad Carlile will discuss what is coming up in Spark 2.0 how all of the components fit together to give better performance at every stage of the complete analytics cycle. He will also dive into the performance characteristics and the cloud/hardware demands of Spark SQL, Spark MLlib, and Spark GraphX. A preview of the work his group did with the developer community to further improve Spark performance with hardware and software innovations will also be part of this talk.

Bio:

Brad brings over 30 years of experience in performance engineering at Oracle, Sun, Cray Research, and Floating Point Systems. Brad Carlile is Senior Director of Strategic Applications Engineering at Oracle, where he now has special focus on Analytics. He holds a bachelor's degree in engineering from Northwestern University and is the author of over two dozen technical papers in high-performance commercial and scientific computing.