Category Archives: ab testing

“Multi-armed bandit” A/B testing optimality proved?

Posted on 01/02/2013 by vkholodkov

Correct me if I’m wrong, but it seems that this paper proves optimality of “multi-armed bandit” approach to A/B testing. The latter one was described in this post earlier this year. For those who do not understand what it is … Continue reading →

Posted in ab testing | Comments Off

Measuring time spent on page

Posted on 03/14/2011 by vkholodkov

One of the challenges of A/B testing is insufficient observations due to low traffic. In other words, if you measured the conversion rate on our web site, it would take months or even years before we’d get conclusive result. What … Continue reading →

Posted in ab testing, nginx | 2 Comments