addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

You Should Probably Be A/B Testing, presented by Nick Disabato

  • May 21, 2014 · 6:00 PM
  • This location is shown only to members

6PM-6:30PM: Gather and socializing, light snacks provided by Wellspring.

6:30PM-7:30PM: @nickd explains why You Should Probably Be A/B Testing

A/B testing is the new hotness in vetting small design changes, but how do you go about doing it? I’ve been A/B testing for lots of clients for the past year or so, and I’ll be talking about my methodology: how, what, and when to test, and how to make sure you’re getting the best impact from your tests.

Nick Disabato is a designer and writer from Chicago. He runs Draft, a small design consultancy in Logan Square, and has been making websites and helping others ship software for quite a while now. He’s probably most known on the internet for writing and publishing Cadence & Slang, a very small book about interaction design.

Join or login to comment.

  • Nick D.

    (2/2) Midway through the test, I killed off the subheader and CTA variants, because they weren’t performing very well relative to control. But the combined variant was performing well, with ~3x lift on clicks to purchase each variant.

    Today, I stopped the test and called it for that variant, and I'm about to roll it out to everyone. Here’s the most important result:

    http://cl.ly/image/1Y0k22003m2n

    The blue line is the variant, green is control. As you can tell, the numbers got pretty stable a couple of weeks ago – now there’s 99% confidence that this will move the needle in my sales. Hooray!

    1 · June 17, 2014

  • Nick D.

    (1/2) Hello! You might be interested in the results of the test that I created live:

    As you might remember, I made two changes:

    – Changed the subheader from “A very small book about interaction design – now in its second edition.” to “The fastest way to understand interaction design, now in its second edition.”
    – Removed the prices from the call to action buttons.

    I also created a third variant that had both of these changes.

    1 · June 17, 2014

  • Nick D.

    I mean, I spoke, so.

    May 21, 2014

  • Jim T.

    Awesome presentation by Nick. I learned a lot.

    May 21, 2014

  • A former member
    A former member

    Learned a lot, great pace and interaction. Thanks to all!

    May 21, 2014

  • Harriett F.

    Looking forward to hearing about A/B Testing.

    May 20, 2014

  • A former member
    A former member

    Yeah I'm in the same boat as Larry.

    April 25, 2014

  • Larry G.

    Argh! I want to go (hi Nick!) but this is the same day as PHPTek out by O'Hare. :-( Poor schedule planning.

    April 24, 2014

51 went

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy