Is A/B Testing (Mis)informing Your Business?
Improper optional stopping increased the average False Discovery Rate…This generates two possible costs for a company. The first is a cost of commission. Facing a false discovery, the company will needlessly switch to a new treatment and incur a switching cost. The second cost of a false discovery is a cost of omission. Erroneously believing to have found an improvement, the company stops […]