English
Related papers

Related papers: A/B Testing in Dense Large-Scale Networks: Design …

200 papers

Randomized experiments on a network often involve interference between connected units; i.e., a situation in which an individual's treatment can affect the response of another individual. Current approaches to deal with interference, in…

Methodology · Statistics 2017-05-17 Guillaume Basse , Edoardo Airoldi

Experimentation is widely utilized for causal inference and data-driven decision-making across disciplines. In an A/B experiment, for example, an online business randomizes two different treatments (e.g., website designs) to their customers…

Methodology · Statistics 2025-01-15 Wenxuan Guo , JungHo Lee , Panos Toulis

Online A/B tests have become increasingly popular and important for social platforms. However, accurately estimating the global average treatment effect (GATE) has proven to be challenging due to network interference, which violates the…

Methodology · Statistics 2023-11-27 Qianyi Chen , Bo Li , Lu Deng , Yong Wang

We propose a method for constructing optimal block designs for experiments on networks. The response model for a given network interference structure extends the linear network effects model to incorporate blocks. The optimality criteria…

Methodology · Statistics 2019-11-26 Vasiliki Koutra , Steven G. Gilmour , Ben M. Parker

Estimation and inference of treatment effects under unconfounded treatment assignments often suffer from bias and the `curse of dimensionality' due to the nonparametric estimation of nuisance parameters for high-dimensional confounders.…

Methodology · Statistics 2025-07-08 Zeqi Wu , Meilin Wang , Wei Huang , Zheng Zhang

While there exists a large amount of literature on the general challenges of and best practices for trustworthy online A/B testing, there are limited studies on sample size estimation, which plays a crucial role in trustworthy and efficient…

Methodology · Statistics 2023-08-21 Jing Zhou , Jiannan Lu , Anas Shallah

Many public health interventions are conducted in settings where individuals are connected to one another and the intervention assigned to randomly selected individuals may spill over to other individuals they are connected to. In these…

Methodology · Statistics 2026-01-14 Junhan Fang , Donna Spiegelman , Ashley Buchanan , Laura Forastiere

Network interference occurs when treatments assigned to some units affect the outcomes of others. Traditional approaches often assume that the observed network correctly specifies the interference structure. However, in practice,…

Methodology · Statistics 2026-02-04 Bar Weinstein , Daniel Nevo

We consider the problem of how to assign treatment in a randomized experiment, in which the correlation among the outcomes is informed by a network available pre-intervention. Working within the potential outcome causal framework, we…

Methodology · Statistics 2017-05-19 Guillaume W. Basse , Edoardo M. Airoldi

The evolving landscape of online multiplayer gaming presents unique challenges in assessing the causal impacts of game features. Traditional A/B testing methodologies fall short due to complex player interactions, leading to violations of…

Applications · Statistics 2024-02-15 Yu Zhu , Zehang Richard Li , Yang Su , Zhenyu Zhao

The presence of interference, where the outcome of an individual may depend on the treatment assignment and behavior of neighboring nodes, can lead to biased causal effect estimation. Current approaches to network experiment design focus on…

Machine Learning · Computer Science 2024-05-22 Zahra Fatemi , Jean Pouget-Abadie , Elena Zheleva

We study treatment effect modifiers for causal analysis in a social network, where neighbors' characteristics or network structure may affect the outcome of a unit, and the goal is to identify sub-populations with varying treatment effects…

Social and Information Networks · Computer Science 2021-11-09 Amir Gilad , Harsh Parikh , Sudeepa Roy , Babak Salimi

No man is an island, as individuals interact and influence one another daily in our society. When social influence takes place in experiments on a population of interconnected individuals, the treatment on a unit may affect the outcomes of…

Methodology · Statistics 2017-08-30 Edward K. Kao

A/B testing is a standard approach for evaluating the effect of online experiments; the goal is to estimate the `average treatment effect' of a new feature or condition by exposing a sample of the overall population to it. A drawback with…

Social and Information Networks · Computer Science 2013-05-31 Johan Ugander , Brian Karrer , Lars Backstrom , Jon Kleinberg

Modern causal decision-making increasingly demands individualized treatment-effect estimation in networks where interventions are high-dimensional, combinatorial vectors. While network interference, effect heterogeneity, and…

Methodology · Statistics 2026-02-24 Yunping Lu , Haoang Chi , Qirui Hu , Zhiheng Zhang

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small…

Methodology · Statistics 2023-06-13 Adam C. Sales , Ethan B. Prihar , Johann A. Gagnon-Bartsch , Neil T. Heffernan

This paper investigates the case of interference, when a unit's treatment also affects other units' outcome. When interference is at work, policy evaluation mostly relies on the use of randomized experiments under cluster interference and…

Methodology · Statistics 2023-06-13 Laura Forastiere , Davide Del Prete , Valerio Leone Sciabolazza

A key question in many network studies is whether the observed correlations between units are primarily due to contagion or latent confounding. Here, we study this question using a segregated graph (Shpitser, 2015) representation of these…

Machine Learning · Computer Science 2025-03-07 Yufeng Wu , Rohit Bhattacharya

Randomized experiments, or A/B tests are used to estimate the causal impact of a feature on the behavior of users by creating two parallel universes in which members are simultaneously assigned to treatment and control. However, in social…

Social and Information Networks · Computer Science 2019-02-20 Craig Tutterow , Guillaume Saint-Jacques

Estimating the effects of long-term treatments through A/B testing is challenging. Treatments, such as updates to product functionalities, user interface designs, and recommendation algorithms, are intended to persist within the system for…

Econometrics · Economics 2025-12-30 Shan Huang , Chen Wang , Yuan Yuan , Jinglong Zhao , Brocco , Zhang