Effective Testing of Spark Programs
Details
Abstract
We all know testing is important, but often end up cutting corners because its too much effort. Come learn how to make testing Spark programs less effort and save your self from future production disasters when your recommendation system starts to return no results. We will explore how to quickly make tests for regular Spark programs, working with DataFrames, and special considerations for making effective unit tests for Spark Streaming. If you are super excited about the subject of testing Spark programs, make sure to also checkout the corresponding Strata NY talk for even more Spark testing fun. http://strataconf.com/big-data-conference-ny-2015/public/schedule/detail/42993
Bio
Holden Karau is a software development engineer at Alpine Data Labs who is active in open source. She is one of the co-authors of the Learning Spark book as well as the author of the first Spark book and has taught Spark workshops. When she isn't wrangling software or data, she enjoys playing with fire and dancing.
Parking at Box HQ
There is street parking available on Del Medio Avenue, Loucks Ave and Los Altos Ave.
Please do not attempt to park in the parking garage at Box HQ, as access into and out of the garage is restricted, and we do not want to leave you and your car stranded in the garage!