Jump to content

    A 4-Way Homepage Split Test (w/ Numbers, Screenshots, and Results)

    Split Test Variants A B C D Homepage

    Split tests. They're often not very accurate, but they are fun to perform! Also if you do them correctly, they can be very profitable.

    If you're careful to perform your split test with small changes, with similar calls to action, and over 1,000's of views, then they can be very telling. Just for fun I'm posting the results of a small test we did on the Copywriting Course Home Page.

    We split tested 4 different variations of the page:

    • Version A: Neville Head + Email Signup
    • Version B: Neville Wall + Email Signup + Phone Signup
    • Version C: Animated Figure + Email Signup + Phone Signup
    • Version D: Neville Head + Email Signup + Phone Signup

    Split test a b c d variation

     

     

     

     

    We wanted to get a rough idea of which two we should select, so this test was ran across roughly 6,500 unique visits.

    Results of this 4-way split test:

    [table id=6 /]

    The winners of this split test were A and C.

    split-a-c.png

    The email-only form with my face looking at it did the best, HOWEVER, it was missing a crucial thing we wanted from this test: PHONE NUMBERS!

    This was not what we wanted, as getting a complete set of contact information was more important to us than slightly more emails (which a percentage of are often not very responsive).

    So we selected the top performing pages with phone numbers, then had to further test these pages to make sure we got the right one to display to all homepage visitors.

     

    So we did another Split Test with the top phone number collecting pages (C vs D):

    c-d-split-test.pngWill the Animated Dude or the Neville Head do better??

    Since this was our home page, and most of our signups come from here, we wanted to further split test the page. So we ran Version C and Version D against each other for roughly 30,000 unique visits to the homepage, and here were the results:

    [table id=7 /]

    The Animated Dude was the winner with 10.08% !!

    Stickman-homepage-400w

     

    Neville Signature


    User Feedback

    Recommended Comments



    Got it...the objective of your testing is in clear focus now. Good stuff Nev...thanks for clarifying!
    Link to comment
    Guest Neville Medhora

    Posted

    Hey Quinton, we call a lot of people, and some of those people buy stuff, so that crowd is very valuable :)
    Link to comment
    Guest Neville Medhora

    Posted

    Glad to clarify!

    Just got done answering a bunch of very confused people over email 😂

    Link to comment
    Now im even more curious if the ERROR in the email was a tactic to get more responses and comments. if so as Arthur Guiness used to say: BRILLIANT!!
    Link to comment
    Guest Neville Medhora

    Posted

    Hahahaha, like 10+ people asked me that via email! No the error wasn't a tactic, it's more of a "Neville-Finishing-A-Post-Way-Too-Late-At-Night" thing :-P
    Link to comment
    Guest Jackson

    Posted

    That's what I thought!

    Now that you've added further explanation, it all makes better sense yow!

    Love reading your blog!

    Link to comment
    Guest Neville Medhora

    Posted

    Glad that clarified it Jackson......I'll do my best to "not write while so sleepy" next time :-P
    Link to comment
    Guest Noah Wizard

    Posted

    I added a bunch of bitmojis to my website because of this article, to make it seem more like a friendly cartoon person is talking to my customers, instead of just a wall of text.

    Not at the stage where I have any kind of real traffic so I can't split test stuff, but I'm gonna start getting 1:1 feedback from a few colleagues.

    Link to comment
    Guest Neville Medhora

    Posted

    Hey Noah, if the BitMoji's are a style you like, then go for it!

    I use the little animated guy because I've been drawing him for a long time, and it's also just the best I can draw :)

    Link to comment
    Guest César

    Posted

    I like what you teach, it's amazing and very useful.
    Link to comment
    Guest Neville Medhora

    Posted

    Thanks César, I appreciate you reading :)
    Link to comment
    Guest Jonathan Drake

    Posted

    I like how the animated face attracted the heatmap from VAS.
    Link to comment
    Guest Neville Medhora

    Posted

    Hahahahah yeah it's human looking enough that the neural net recognizes it as a human's face :)
    Link to comment
    Guest Neville Medhora

    Posted

    Yes it was just slightly different. Overall I've been pleased with the results of the animated dude pointing at the form :)
    Link to comment
    Guest Neville Medhora

    Posted

    Hey Kim, no worries, it was a goof on my part! We picked a different "winner" as the real winner only collected emails, not names and numbers also :)
    Link to comment
    Guest Jason

    Posted

    It would also be interesting to split test Nev Head looking at the text and looking away from the text. My hypothesis would be the Nev Head looking away would perform worse, but how much worse would be the interesting part. Feel free to test it and post the results!! :)
    Link to comment
    Guest Neville Medhora

    Posted

    Hey Jason, that WOULD be interesting, however it's not interesting enough to test on a lot of live customers.

    Or maybe I could fake publish that there was a 40% increase when the head is turned away, and then all of a sudden people would be posting "Away Face" home pages 😁

    Link to comment
    Guest Dave Nichols

    Posted

    I thought A looked the best. On D, because you’re image is lower on the page, it takes away some of your authority. On A, you look like an expert I can learn from and trust. While D reminds me of a kid brother. Since C can get almost 10% and asks for a phone number, it surprised me that asking for a phone on D would be the cause of the 2% drop. Maybe if you raise the image on D you will increase the conversion rate. I’m reading this on a phone so maybe aspect ratio is off and the images are already the same. Thank you for all the great content!
    Link to comment
    Guest What do clocks, hard drives and websites have in common? - Mediabytes

    Posted

    […] too long ago, an A/B study done by heavyweight Neville Medora on sign ups analysing four different sign-up screens yielded some […]
    Link to comment



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now

    • Join 55,000+ people getting our newsletter

      nev-and-logo-going-into-email (3).gif

      - Get notified of new posts -
      - Get weekly S.W.I.P.E.S. Email -
      - Get a free masterclass in copy -
      - People love our emails, see testimonials -

    ×
    ×
    • Create New...
    Guest