AB Testing for websites
70.7K views | +0 today
Follow
Your new post is loading...
Your new post is loading...
Scooped by Vincent Demay
Scoop.it!

Bayesian Bandit Explorer

A demo of a work-in-progress tool for exploring the performance of "Bayesian Bandits" for solving the Multi-Armed Bandit problem

No comment yet.
Scooped by Philippe Gassmann
Scoop.it!

Multi-armed bandit experiments

Multi-armed bandit experiments | AB Testing for websites | Scoop.it

This article describes the statistical engine behind Google Analytics Content Experiments. Google Analytics uses a multi-armed bandit approach to managing online experiments.

No comment yet.
Scooped by Philippe Gassmann
Scoop.it!

20 lines of code that will beat A/B testing every time

20 lines of code that will beat A/B testing every time | AB Testing for websites | Scoop.it

A/B testing is used far too often, for something that performs so badly. It is defective by design: Segment users into two groups. Show the A group the old, tried and true stuff. Show the B group the new whiz-bang design with the bigger buttons and slightly different copy. After a while, take a look at the stats and figure out which group presses the button more often. Sounds good, right? The problem is staring you in the face. It is the same dilemma faced by researchers administering drug studies. During drug trials, you can only give half the patients the life saving treatment. The others get sugar water. If the treatment works, group B lost out. This sacrifice is made to get good data. But it doesn't have to be this way.

Fred's comment, October 7, 2014 9:45 AM
ah oui on comprend bien avec cet article!
Vincent Demay's comment, October 7, 2014 10:02 AM
like @Fred