Running multiple tests at a time in Adobe Target
Aug 1, 2017If you’ve got enough traffic to support it, you should try and run more than one test at a time. This will help you get the most out of your traffic and testing efforts and will help you find the wins quicker.
The problem with running multiple tests at a time is that overlapping tests will often create noise with each other. Noise can make it hard to reach significance and can also lead to false positives. To eliminate the possibility of noise, I recommend splitting the traffic so that visitors can only get into one test at a time.
I like to use a profile script to do this to split up traffic. The Two Groups profile script is possibly the most popular of all Target profile scripts and can be found in almost every Target account. It may even be in your account and you didn’t even know it. This script randomly assigns visitors to one of two groups.
The code for Two Groups looks something like this:
var ran_number=Math.floor(Math.random()*99);
if (ran_number <= 49) {return 'GroupA';} else {return 'GroupB';}
}
More than two
But what if you want to have more than two groups? A slight modification to the code will allow you to split traffic into as many groups as you want.
var ran_number=Math.floor(Math.random()*99);
return ran_number;
}
Essentially, all this script does is assign each visitor a persistent random number. Then in your test set up, you can target based on a grouping of those numbers. So to split traffic into two groups, one group would be where randomNumber < 50 and the other would be where randomNumber is >= 50. For three groups, you would just divide the numbers into thirds and so on. The only downside to this method, is that groups are fluid and not strict. Meaning, you could accidentally overlap the groups if you aren’t paying attention.