At SiteSpect, our 350+ functional test scenarios -- over 550,000 tests -- used to take 8 hours to run. For developers who often received their results weeks after finishing their code, or QA, who had to parse through test results that clumped together a hundred revisions at a time, this system was frustrating and inefficient.
Our new testing infrastructure uses Jenkins, MySQL, and Perl scripts to parallelize the testing process over 75 machines, reducing the run time to 30 minutes. All commits to trunk and major branches are automatically tested, and developers can start a run on their development branches at any time.
If you are interested in Jenkins or Testing Architecture, join us at this talk to discuss:
· Parallelization in Jenkins
· Jenkins performance pitfalls and solutions
· Distributing tests to a variety of environments
· Using a Database to analyze test results intelligently
· Designing VMs for easy maintenance
Dustin Masterson and Josh Shapiro are SiteSpect's Automated Testing Team. SiteSpect provides the world’s only tag-free digital optimization platform, for testing, targeting, and optimizing your entire web or mobile site and architecture.