A/B Test for WordPress
Variations Not Getting Equal Views (4 posts)

  1. webtrainingwheels
    Posted 4 years ago #

    Overall am loving this plugin!
    I have been running a test and am noticing that the numbers of views on each variation are wildly different - one of them has been shown 3000+ times, the other only 400+ times. I was expecting those numbers to be more similar to each other.
    Is this normal behavior? Or what are the factors that would influence when one variation is shown over the other and why it might skew this way?
    Many thanks!


  2. Tanel
    Posted 4 years ago #

    I'm gonna try the plugin out right away and see if it happens to me too. But as I understood from the intro video, the variations are shown randomly with no balancing taking place(?), which might lead to very unequal page views. If that's the case then it's definitely something that needs improvement.

  3. webtrainingwheels
    Posted 4 years ago #

    Will definitely be interested to see if your experience is the same. Overall I have to say I do love the plugin, and even with the uneven numbers of views, in combination with the Google Analytics tracking I implemented, I was still able to gather plenty of data in order to effectively compare and test the elements that I wanted to.

  4. Matt Barrett (corradomatt)
    Posted 4 years ago #

    I haven't used the plugin (just found it this morning) but it looks great! The complete random-ness of the variation display doesn't bother me too much but it would be great if we could set a percentage for each test.

    Say you wanted variation b to receive around 20% of the views you could set that in the admin. I don't think it would be necessary to have that option be absolute - meaning that getting it close to whatever percentage the admin set would be great. I think that feature would be especially helpful if there were several (anything more than 2) variations being tested.

    Either way, this plugin looks awesome. I'm anxious to start trying it with some of my clients. If it works the way I expect this is something I would gladly pay for, especially if there was good support and a feature like the one I just suggested. :)

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic