Interpreting A/B Test Results

I ran a test trying to determine the optimal email send time, sending 50% of the list at Time X and 50% of the list at Time Y.

Time X had an unique open rate of 31.02%

Time Y had an unique open rate of 31.59%

I've run the results through a statistical significance calculator and it shows that the results are significant at 90%, 95%, and 99%. However, if you were to ask me my recommendation, I would still say it's too close to call and there is only a marginal difference between the two send times and either time would work well and yield similar results.

How would you interpret these results based on the open rate numbers?

submitted by /u/11_guy
[link] [comments]

source https://www.reddit.com/r/Emailmarketing/comments/g9ddej/interpreting_ab_test_results/