English

Success Stories from a Democratized Experimentation Platform

Methodology 2020-12-21 v1 Computation

Abstract

We demonstrate the effectiveness of democratization and efficient computation as key concepts of our experimentation platform (XP) by presenting four new models supported by the platform: 1) Weighted least squares, 2) Quantile bootstrapping, 3) Bayesian shrinkage, and 4) Dynamic treatment effects. Each model is motivated by a specific business problem but is generalizable and extensible. The modular structure of our platform allows independent innovation on statistical and computational methods. In practice, a technical symbiosis is created where increasingly advanced user contributions inspire innovations to the software that in turn enable further methodological improvements. This cycle adds further value to how the XP contributes to business solutions.

Keywords

Cite

@article{arxiv.2012.10403,
  title  = {Success Stories from a Democratized Experimentation Platform},
  author = {Eskil Forsell and Julie Beckley and Simon Ejdemyr and Veronica Hannan and Andy Rhines and Martin Tingley and Matthew Wardrop and Jeffrey Wong},
  journal= {arXiv preprint arXiv:2012.10403},
  year   = {2020}
}
R2 v1 2026-06-23T21:05:03.599Z