Thursday, June 4, 2020

Is this the right way to choose a winner from your AB creative test?

Say you have 100 customers who share a common factor. You do 5 separate A/B creative tests and your audience split is 80/20 (split was determined based on statistical significance). The 80% group get 5 different creatives spaced 1 week apart and the 20% group get a different set of 5 different Creatives 1 week apart. After all sends, you sort your data for all 10 creatives by unique clicks and determine that the top 3 with highest clicks are the ones sent to the 20% group. Is it fair then to apply that creative to the full 100% moving forward? Conversion metrics will not be available to you until the end of the season, so you have to only rely on front end metrics such as clicks and open to clicks.

submitted by /u/lavenderlove18
[link] [comments]

source https://www.reddit.com/r/Emailmarketing/comments/gwkoby/is_this_the_right_way_to_choose_a_winner_from/

No comments:

Post a Comment