Refactor::Chicago

Name: You Should Probably Be A/B Testing, presented by Nick Disabato
Start: 2014-05-21T23:00:00Z

You Should Probably Be A/B Testing, presented by Nick Disabato

May 21, 2014 · 6:00 PM
This location is shown only to members

6PM-6:30PM: Gather and socializing, light snacks provided by Wellspring.

6:30PM-7:30PM: @nickd explains why You Should Probably Be A/B Testing

A/B testing is the new hotness in vetting small design changes, but how do you go about doing it? I’ve been A/B testing for lots of clients for the past year or so, and I’ll be talking about my methodology: how, what, and when to test, and how to make sure you’re getting the best impact from your tests.

Nick Disabato is a designer and writer from Chicago. He runs Draft, a small design consultancy in Logan Square, and has been making websites and helping others ship software for quite a while now. He’s probably most known on the internet for writing and publishing Cadence & Slang, a very small book about interaction design.

Join or login to comment.

Hit enter to add your reply

Nick D.

(2/2) Midway through the test, I killed off the subheader and CTA variants, because they weren’t performing very well relative to control. But the combined variant was performing well, with ~3x lift on clicks to purchase each variant.

Today, I stopped the test and called it for that variant, and I'm about to roll it out to everyone. Here’s the most important result:

http://cl.ly/image/1Y0k22003m2n

The blue line is the variant, green is control. As you can tell, the numbers got pretty stable a couple of weeks ago – now there’s 99% confidence that this will move the needle in my sales. Hooray!

1 · June 17, 2014
Nick D.

(1/2) Hello! You might be interested in the results of the test that I created live:

As you might remember, I made two changes:

– Changed the subheader from “A very small book about interaction design – now in its second edition.” to “The fastest way to understand interaction design, now in its second edition.”
– Removed the prices from the call to action buttons.

I also created a third variant that had both of these changes.

1 · June 17, 2014
Nick D.

I mean, I spoke, so.

0 · May 21, 2014
Jim T.

Awesome presentation by Nick. I learned a lot.

0 · May 21, 2014
A former member

Learned a lot, great pace and interaction. Thanks to all!

0 · May 21, 2014
Harriett F.

Looking forward to hearing about A/B Testing.

0 · May 20, 2014
A former member

Yeah I'm in the same boat as Larry.

0 · April 25, 2014
Larry G.

Argh! I want to go (hi Nick!) but this is the same day as PHPTek out by O'Hare. :-( Poor schedule planning.

0 · April 24, 2014