Epic fail: figuring out Selenium test results

Your Selenium test failed. Maybe your test environment has a glitch... or maybe your test isn't well designed... or maybe the application changed without you knowing it... or maybe, just maybe, your test found a bug.

Sometimes it's hard to tell what a browser test failure means. In this live, hands-on session we'll we will look at real examples running against real features in public test environments to take a close critical look at real browser test failures and what they mean.

We will present analysis techniques applicable to any test framework, but we will show specific sophisticated examples from our Cucumber and Page Object framework that uses RSpec assertions. Along the way we will examine how to set up builds of Selenium tests in Jenkins, and we'll look at test result steps archived at Sauce Labs with video playback of failed tests.

At the end of the session, participants will be able to reason about browser test failures with some authority, and will be familiar with how to work with the browser test failures that WMF makes public, in order to contribute to the discussion of quality at WMF: not only quality of applcations, but also of test environments and of test design.

Video stream: http://www.youtube.com/watch?v=fs2VmlQ_h7Q
IRC channel for questions: #wikimedia-dev on Freenode

More: https://www.mediawiki.org/wiki/Meetings/2013-09-18

Join or login to comment.

  • Quim G.

    1 · September 19, 2013

  • Quim G.

    During this meetup a QA mailing list was mentioned several times. URL: https://lists.wikimedia.org/mail...­

    September 19, 2013

  • Robert B.

    Awesome

    1 · September 19, 2013

  • Isa

    Very great talk! Thanks Chris. Thanks everyone - Marisa Burt

    1 · September 18, 2013

  • Arpit G.

    Question (doesn't have to be asked right at this moment): How often do you run sanity tests run against production and how do you configure tests to be run at different levels (test vs prod)

    1 · September 18, 2013

    • Quim G.

      Thank you! I just asked the question because I happened to look my mailbox. Please ask at http://webchat.freeno...­ if you don't mind. (I'll keep watching the mailbox though) ;)

      September 18, 2013

  • Quim G.

    Video stream: http://www.youtube.com/watch?v=...­
    IRC channel for questions: #wikimedia-dev on Freenode

    September 18, 2013

  • Dave L.

    Same night as SF NerdNite! :(

    September 3, 2013

    • Quim G.

      Ouch. But it's really difficult to find an evening in SF that won't clash with another tech event...

      September 4, 2013

  • Matt B.

    Looking forward to viewing the talk, thank you for noting that it will be available via streams on the Internet

    1 · August 29, 2013

  • Isa

    Online please.

    August 29, 2013

  • Arpit G.

    I am on the east coast but would love to participate via online streaming. Thanks.

    August 29, 2013

People in this
Meetup are also in:

You don't have to be an expert to start your own Meetup G roup

Get started Learn more
Katie

I'm surprised by the level of growth I've seen since becoming an organizer, it's given me more confidence in my abilities.

Katie, started NYC ICO

Start your Meetup today

Act now and get 50% off.
Until February 1.

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy