Who’s Testing What #2

Checkout Page at Doctor FootCare

The following example comes from one of  Bryan Eisenberg’s experiments.

There are nine differences between the two variants of the Doctor FootCare checkout page shown in Figure 1. If a designer would show you these 2 screenshots and ask which one should be deployed live, could you guess which one will havea better conversion rate? Could you estimate what the increase/decrease  is between the 2 conversion rates and whether that difference is significant? We will share the results at the end of the section, but I encourage the readers to think about it before reading the answer.

Version A

Version A

Version B

Version B

source:http://exp-platform.com/Documents/GuideControlledExperiments.pdf

For the Doctor FootCare checkout page, variant A in Figure 1 outperformed variant B by an order of magnitude. In reality, the site ―upgraded from the A to B and lost 90% of their revenue. Most of the changes in the upgrade were positive, but the coupon code was the critical one: people started to think twice about whether they were paying too much because there are discount coupons out there that they do not have. By removing the discount code from the new version (B), conversion-rate increased 6.5% relative to the old version (A).

For the Doctor FootCare checkout page, variant A in Figure 1 outperformed variant B by an order of magnitude. In reality, the site ―upgraded‖ from the A to B and lost 90% of their revenue. Most of the changes in the upgrade were positive, but the coupon code was the critical one: people started to think twice about whether they were paying too much because there are discount coupons out there that they do not have. By removing the discount code from the new version (B), conversion-rate increased 6.5% relative to the old version (A).

Pitstop Media is a Vancouver based conversion rate optimization company which offers results oriented landing page testing and conversion rate optimization services. Our A/B and multivariate tests have helped of companies increase conversion rates by as much as 75%. Let us increase your conversion rates, too!

Rate this post

VN:F [1.9.3_1094]
Rating: 9.8/10 (4 votes cast)
VN:F [1.9.3_1094]
Rating: +2 (from 2 votes)
Who’s Testing What #2, 9.8 out of 10 based on 4 ratings

Related posts:

  1. Who’s Testing What #1
  2. Testing the Checkout Process – The Progress Bar Design
  3. Buttons Should Look Like Buttons
  4. Could This Be The Best Checkout Button?
  5. Have A Web Analytics Tool Installed on Your Website

2 Responses to “Who’s Testing What #2”

  1. Chris said:

    Aug 18, 10 at 10:55 am

    So do they not offer any discounts now, or have they implemented a new way to offer discounts and let customers use coupons – or did they simply remove the Discount notification unless a discount was actually applied?

    VA:F [1.9.3_1094]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.3_1094]
    Rating: 0 (from 0 votes)
  2. TraiaN said:

    Aug 18, 10 at 11:29 am

    Chris, I am not aware of how they changed the discount handling.

    VN:F [1.9.3_1094]
    Rating: 0.0/5 (0 votes cast)
    VN:F [1.9.3_1094]
    Rating: 0 (from 0 votes)

Leave a Reply