English
Related papers

Related papers: Network experimentation at scale

200 papers

The conclusions of randomized controlled trials may be biased when the outcome of one unit depends on the treatment status of other units, a problem known as interference. In this work, we study interference in the setting of one-sided…

Methodology · Statistics 2022-11-01 Jennifer Brennan , Vahab Mirrokni , Jean Pouget-Abadie

Estimating causal effects under interference is pertinent to many real-world settings. Recent work with low-order potential outcomes models uses a rollout design to obtain unbiased estimators that require no interference network…

Methodology · Statistics 2025-02-12 Mayleen Cortez-Rodriguez , Matthew Eichhorn , Christina Lee Yu

This paper studies inference in cluster randomized trials where treatment status is determined according to a "matched pairs" design. Here, by a cluster randomized experiment, we mean one in which treatment is assigned at the level of the…

Econometrics · Economics 2025-08-14 Yuehao Bai , Jizhou Liu , Azeem M. Shaikh , Max Tabord-Meehan

We present current methods for estimating treatment effects and spillover effects under "interference", a term which covers a broad class of situations in which a unit's outcome depends not only on treatments received by that unit, but also…

Applications · Statistics 2020-01-16 Peter M. Aronow , Dean Eckles , Cyrus Samii , Stephanie Zonszein

Causal inference on populations embedded in social networks poses technical challenges, since the typical no interference assumption frequently does not hold. Existing methods developed in the context of network interference rely upon the…

Methodology · Statistics 2024-04-12 Vanessa McNealis , Erica E. M. Moodie , Nema Dean

In randomized controlled trials without interference, regression adjustment is widely used to enhance the efficiency of treatment effect estimation. This paper extends this efficiency principle to settings with network interference, where a…

Methodology · Statistics 2025-02-18 Xinyuan Fan , Chenlei Leng , Weichi Wu

This paper investigates the case of interference, when a unit's treatment also affects other units' outcome. When interference is at work, policy evaluation mostly relies on the use of randomized experiments under cluster interference and…

Methodology · Statistics 2023-06-13 Laura Forastiere , Davide Del Prete , Valerio Leone Sciabolazza

We consider the problem of how to assign treatment in a randomized experiment, in which the correlation among the outcomes is informed by a network available pre-intervention. Working within the potential outcome causal framework, we…

Methodology · Statistics 2017-05-19 Guillaume W. Basse , Edoardo M. Airoldi

This paper considers the problem of inference in cluster randomized experiments when cluster sizes are non-ignorable. Here, by a cluster randomized experiment, we mean one in which treatment is assigned at the cluster level. By…

Econometrics · Economics 2024-04-11 Federico Bugni , Ivan Canay , Azeem Shaikh , Max Tabord-Meehan

We address estimation of intervention effects in experimental designs in which (a) interventions are assigned at the cluster level; (b) clusters are selected to form pairs, matched on observed characteristics; and (c) intervention is…

Methodology · Statistics 2014-11-24 Zhenke Wu , Constantine E. Frangakis , Thomas A. Louis , Daniel O. Scharfstein

Estimating the treatment effect within network structures is a key focus in online controlled experiments, particularly for social media platforms. We investigate a scenario where the unit-level outcome of interest comprises a series of…

Methodology · Statistics 2025-05-28 Yilin Li , Lu Deng , Yong Wang , Wang Miao

It is standard practice in online retail to run pricing experiments by randomizing at the article-level, i.e. by changing prices of different products to identify treatment effects. Due to customers' cross-price substitution behavior, such…

Applications · Statistics 2024-02-23 Lars Roemheld , Justin Rao

The reliability of controlled experiments, commonly referred to as "A/B tests," is often compromised by network interference, where the outcomes of individual units are influenced by interactions with others. Significant challenges in this…

Machine Learning · Statistics 2024-07-02 Yuan Yuan , Kristen M. Altenburger

Interference arises when the treatment assigned to one individual affects the outcomes of other individuals. Commonly, individuals are naturally grouped into clusters, and interference occurs only among individuals within the same cluster,…

Methodology · Statistics 2026-04-15 Chao Cheng , Fan Li

Online user-generated content platforms allocate billions of dollars of promotional traffic through algorithms in two-sided marketplaces. To evaluate updates to these algorithms, platforms frequently rely on creator-side randomized…

Econometrics · Economics 2026-03-10 Ruohan Zhan , Shichao Han , Yuchen Hu , Zhenling Jiang

Randomized experiments are a powerful methodology for data-driven evaluation of decisions or interventions. Yet, their validity may be undermined by network interference. This occurs when the treatment of one unit impacts not only its…

Methodology · Statistics 2024-10-08 Sadegh Shirani , Mohsen Bayati

Estimation of social influence in networks can be substantially biased in observational studies due to homophily and network correlation in exposure to exogenous events. Randomized experiments, in which the researcher intervenes in the…

Social and Information Networks · Computer Science 2017-09-28 Sean J. Taylor , Dean Eckles

Randomized experiments are the gold standard for estimating treatment effects, yet network interference challenges the validity of traditional estimators by violating the stable unit treatment value assumption and introducing bias. While…

Methodology · Statistics 2024-09-02 Xin Lu , Hongzi Li , Hanzhong Liu

Interference occurs when a unit's treatment (or exposure) affects another unit's outcome. In some settings, units may be grouped into clusters such that it is reasonable to assume that interference, if present, only occurs between…

Methodology · Statistics 2023-08-24 Chanhwa Lee , Donglin Zeng , Michael G. Hudgens

If an experimental treatment is experienced by both treated and control group units, tests of hypotheses about causal effects may be difficult to conceptualize let alone execute. In this paper, we show how counterfactual causal models may…

Methodology · Statistics 2012-08-03 Jake Bowers , Mark Fredrickson , Costas Panagopoulos