- Testing @SiteSpect
At SiteSpect, our 350+ functional test scenarios -- over 550,000 tests -- used to take 8 hours to run. For developers who often received their results weeks after finishing their code, or QA, who had to parse through test results that clumped together a hundred revisions at a time, this system was frustrating and inefficient. Our new testing infrastructure uses Jenkins, MySQL, and Perl scripts to parallelize the testing process over 75 machines, reducing the run time to 30 minutes. All commits to trunk and major branches are automatically tested, and developers can start a run on their development branches at any time. If you are interested in Jenkins or Testing Architecture, join us at this talk to discuss: · Parallelization in Jenkins · Jenkins performance pitfalls and solutions · Distributing tests to a variety of environments · Using a Database to analyze test results intelligently · Designing VMs for easy maintenance Bio: Dustin Masterson and Josh Shapiro are SiteSpect's Automated Testing Team. SiteSpect provides the world’s only tag-free digital optimization platform, for testing, targeting, and optimizing your entire web or mobile site and architecture.
- Incorporating Testing into Day-to-Day Workflows at Wayfair
Thorough testing takes time, and with a rapid development model, it is often the first thing sacrificed to get a feature out the door. At Wayfair, our 300+ engineering department needed an easy way for all developers to run tests against their code without adding much overhead to the development process. Inspired by a service at Etsy called "try" (more info here (http://codeascraft.com/2011/10/11/did-you-try-it-before-you-committed/)), we developed Yoda, a pure Bash, cross-platform, command line test platform. Since its creation, test run frequency has dramatically increased, with an average of 360 tests run per day. Come learn more about the development of this tool, and see how Yoda has integrated testing into Wayfair Engineering in a seamless way. We’re really excited, and as we’re planning to open source the tool, we’d love to show it off. by Ken Petti A quick bio: Ken is a founding member of Wayfair’s Testing Development team. In addition to developing Yoda, he has been involved in a variety of projects including: manual tests, Selenium Autotests, style checkers, PHPunit and integration tests. Before transitioning to the Testing Development team, Ken was a key member of Wayfair’s Frontline technical support team, troubleshooting many of the problems he now works to prevent. How to Find: Copley Mall-> elevator to 3rd floor/SKYLOBBY-> 4 Copley Place-> 7th floor.
- Community Talks
Join us for our first fall Meetup. The night will feature two 25 min talks from our community. Here they are: First Talk Automation in Deployment Pipelines by Jason DeGeorge Continuous integration, continuous deployment, and the holy grail, continuous delivery! Picture new features and bug fixes seemlessly flowing through your deployment pipeline from the development directly to production. That sounds amazing! But getting to that point has proven to be a challenge. Teams have to navigate project process, engineering and QA policies, tools, automation suites, release engineering, devops automation, and application architecture. Not to mention all the humans who have to build and maintain these systems. The easy answer of "Automate everything" doesn't tell the whole story. Jason DeGeorge has been managing technology and technology teams for the past 15 years at some notable technology companies in the Boston Area. Before PlatformQ, Jason served as Vice President of Engineering/Technology at Nellymoser where he managed the Engineering, Systems and IT Departments. He built Nellymoser's server team and was responsible for the technical direction and implementation architecture. Before Nellymoser, Jason served as CTO of Q2 Technologies, where he was responsible for delivering high volume, innovative solutions as well as leading the company into new technology areas. He has over 18 years of experience designing, implementing, deploying and managing multi-tiered applications in new markets. Mr. DeGeorge studied Computer Science and Mathematics at Wesleyan University, Boston University, and Harvard University. He currently holds a Bachelor's degree from Wesleyan University in Mathematics. Second Talk "Large Scale Development Culture Change: Google and the US Government" by Mike Bland In October 2013, the disastrous rollout of the healthcare.org (http://healthcare.org/) website created a crisis for the Obama administration. In the wake of the successful recovery from this crisis, an opportunity has emerged to bring development practices throughout the US government up-to-date with modern industry standards. Having helped drive widespread development culture change at Google, I have been recruited to join the effort to reform government IT. In this talk, I will summarize the organizational and psychological obstacles to driving adoption of automated testing at Google, the strategies and tactics the Testing Grouplet and others employed to overcome them over the course of five years, and map these experiences to the current state of affairs within the Federal government as I currently understand them. Mike Bland was a software developer at Google from 2005 to 2011. Prior to working on websearch infrastructure, Mike led the Testing Grouplet and Fixit Grouplet; was a member of the Test Mercenaries, Testing Tech, and Build Tools teams; and was instrumental in bringing about the development culture changes that made thorough developer testing the accepted cultural norm. Having taken three years off from the industry and studying at Berklee College of Music, he has recently published articles forCommunications of the ACM and Martin Fowler's website that use early 2014's "goto fail" and Heartbleed bugs to press for greater accountability and adoption of automated testing amongst developers, is working with the OpenSSL team to improve its automated testing, and is soon to join the effort to reform US government IT. http://mike-bland.com (http://mike-bland.com/)
- Summer Kickoff BBQ
Amazon is going to sponsor a Summer BBQ and our group is invited! It will be a great way to kickoff the summer season and get to know one another a bit more! Thank you Amazon! Here are the details: Amazon’s Digital Products Team in Cambridge is excited to host a summer Networking Event for both the Automated Testing (http://www.meetup.com/Automated-Testing-Boston/) @ Boston and Java Developer (http://www.meetup.com/boston-java/) Meetup groups! Our office would like to engage with the local software engineering community and hope to sponsor some of your Meetups in the future. Members of our engineering team from all disciplines will be at this event. We have worked to produce best-selling Kindle Fire tablets with breakthrough software technology, Kindle e-readers that have revolutionized reading, and Amazon Fire TV, a tiny yet powerful way to watch the best movies and TV shows in the comfort of your living room. We hope you will take this opportunity to get to know us! Menu: A wide variety of appetizers and sandwiches will be available as well as draught beer, sangria and wine.
- High Quality Software from Small Agile Teams
High Quality Software from Small Agile Teams by: Gleb Bahmutov How does your small company compete with large competitors?They have a product line, clients and revenue streams, while you have to start fromscratch. They have written test cases, automated testing, regression tests and an army of testers bangingon each release, while you have very limited testing time budget. In my presentationI will show how the small software team at Kensho delivers new features very quicklyand without sacrificing quality. In fact I believe that in many respects (like bug reporting, fix turn around time)Kensho does much better job than much larger companies I worked at before. This talk will be very different from Ian Botts' "Testing at Amazon" presentation. We are veryopen about the tools we use and the processes we follow. A lot of individual parts are described in my software blog "Better world by Better software" http://bahmutov.calepin.co/ and any open sourced software is licensed under the permissive MIT license at https://github.com/bahmutov
- Testing at Amazon
This will be a special meetup sponsored by Amazon. They are going to host us at Maggiano's Restaurant and have one of their own provide us with some inside insights into their testing practices. There will be limited space at this event so sign up soon and only if you are actually going to be able to attend the event. This way we can make sure that those that want to attend can get a spot! Thanks guys! This will be a great one! Presenter: Ian Botts, Senior QA Manager, Amazon Title: Scientific Basis for Testing with Immediate Implications Presentation summary: A highly versatile and robust testing approach that uses the scientific method and empirical falsification will be presented. The implications to different testing phases and activities will be discussed. Bio: Ian Botts is Quality Assurance Manager in Amazon’s Digital Projects group. Ian has been in Quality Assurance for over 15 years working in the mobile devices and media consumption space since moving from Games development. Ian is credited with lead QA roles with the Original XBOX, Windows Media Center, and various non-public releases with the Department of Defense and Vulcan research. Ian is also credited with the championing and adapting SBTM (http://en.wikipedia.org/wiki/Session-based_testing) (Sessions based Test Management) working closely with the Jon Bach & James Bach to bring exploratory and scientific testing practices to software development. Ian was born and raised in South East London, England, moved to Seattle, WA and currently resides in Boston, MA.
- How To Use Selenium Successfully
Hey guys, this will be our fifth Meetup! Thank you Solano Labs for organizing, Akamai for hosting & for the pizza/drinks & Dave for the talk! Here is the schedule: 6:30pm - Check-in, pizza / drinks 7:00 pm - Talk begins 8:00pm - Q&A & General Discussion Special Addition to the Night with Tech Current Events Opener Talk "Mike Bland will give a 10-minute lightning talk about the recent Apple SSL bug, demonstrating specifically how it could've been prevented by basic unit testing discipline. (Slides: http://goo.gl/F0URUR )" The Night's Talk by Dave Haeffner How To Use Selenium Successfully Want to learn how to use Selenium from the ground up? -- In an hour I can show you how to start from nothing and build out a well factored, maintainable, resilient, and parallelized set of tests that will run locally, on a Continuous Integration server, and in the cloud. These tests will not only work well, but exercise relevant functionality that matters to the business. Bio: Dave is the writer of Elemental Selenium -- a free, once weekly Selenium tip newsletter that is read by hundreds of testing professionals. He is also the creator and maintainer of ChemistryKit (an open-source Selenium framework). He has helped numerous companies successfully implement automated acceptance testing; including The Motley Fool, ManTech International, Sittercity, and Animoto. He is a founder and co-organizer of the Selenium Hangoutand has spoken at numerous conferences and meetups about acceptance testing. ps. Lets show some love to our host and like their new Meetup FB page! https://www.facebook.com/Akamaimeetups
- DevOps for Test Engineers: Adventures with AWS, Ansible, and Vagrant
Hey everyone, because of the snow I am going to reschedule the Meetup to Monday. Please note the LOCATION CHANGE. Thank you Akamai for hosting us on a date change last minute! **** Hey guys, this will be our forth Meetup! Thank you Solano Labs (http://www.solanolabs.com) for organizing, Gazelle (http://www.gazelle.com) for hosting us, Dyn (http://www.dyn.com) for the pizza/drinks & William for the talk! Here is the schedule: 6:30pm - Check-in, pizza / drinks 7:00 pm - Talk begins 8:00pm - Q&A & General Discussion The Night's Talk by William Daly DevOps for Test Engineers: Adventures with AWS, Ansible, and Vagrant Description: We’ve all seen code that works perfectly on a developer’s laptop or CI server, but fails in production. Differences such as outdated software versions, more restrictive file permissions, or incorrect settings can cause bugs that evade automated tests. Fortunately, provisioning tools such as Ansible can ensure consistency between dev, test, and production environments. Test Engineers can leverage these tools to reduce risk and increase confidence that code will work in production. In this talk, I’ll show how to use the same Ansible scripts to provision both Vagrant VMs (for local development) and AWS instances (for automated tests and deployment). Along the way, I’ll point out some common pitfalls and how to avoid them. Finally, I’ll discuss how understanding your production infrastructure can make you a more effective Test Engineer. Bio: Will Daly is a Test Engineer at EdX (https://www.edx.org/), a non-profit that puts high-quality classes online for free.
- Scaling Your Automated Tests Effectively
Hey guys, this will be our third Meetup! Thank you Solano Labs for organizing, Gazelle for hosting us & Dyn for the pizza and drinks! Since it is also near the holidays, I want to suggest we all go for a drink after the Meetup. We can have an early celebration as a group! Here is the schedule: 6:30pm - Check-in, pizza / drinks 7:00 pm - Talk begins 8:00pm - Q&A & General Discussion 8:30pm - Head to Lucky Lounge (355 Congress Street) http://www.yelp.com/biz/luckys-lounge-boston-2?nb=1 The Night's Talk by Stephen Vance Scaling Your Automated Tests Effectively Oftentimes the arguments against test automation are grounded in the same pains we feel as a test automation effort grows. Tests become brittle, slow, and hard to maintain so people become frustrated, stop writing them, and sometimes stop running them. This can be mitigated and avoided. We'll talk about the causes of and solutions to this dilemma, with code. Stephen Vance (@StephenRVance (https://twitter.com/StephenRVance), vance.com (http://www.vance.com/)) has served in most roles in the software product development process across a wide range of industries and technologies. For the last several years, he has focused on coaching teams in Lean and Agile approaches to development and testing as a practitioner, manager and consultant. He is currently an independent Lean/Agile coach consulting to Zipcar (http://www.zipcar.com/). He is the author of Quality Code: Software Testing Principles, Practices, and Patterns (http://www.amazon.com/Quality-Code-Software-Principles-Practices/dp/0321832981), available through Addison-Wesley.
- Code Coverage for Testing