English
Related papers

Related papers: Network experimentation at scale

200 papers

We study causal effect estimation from observational data under interference. The interference pattern is captured by an observed network. We adopt the chain graph framework of Tchetgen Tchetgen et. al. (2021), which allows (i) interaction…

Statistics Theory · Mathematics 2024-07-30 Sohom Bhattacharya , Subhabrata Sen

With the advancement of computational network science, its research scope has significantly expanded beyond static graphs to encompass more complex structures. The introduction of streaming, temporal, multilayer, and hypernetwork approaches…

Social and Information Networks · Computer Science 2024-05-29 Michał Czuba , Mateusz Nurek , Damian Serwata , Yu-Xuan Qiu , Mingshan Jia , Katarzyna Musial , Radosław Michalski , Piotr Bródka

The bulk of causal inference studies rule out the presence of interference between units. However, in many real-world scenarios, units are interconnected by social, physical, or virtual ties, and the effect of the treatment can spill from…

Methodology · Statistics 2023-11-03 Falco J. Bargagli-Stoffi , Costanza Tortù , Laura Forastiere

Many public health interventions are conducted in settings where individuals are connected to one another and the intervention assigned to randomly selected individuals may spill over to other individuals they are connected to. In these…

Methodology · Statistics 2026-01-14 Junhan Fang , Donna Spiegelman , Ashley Buchanan , Laura Forastiere

Modern causal decision-making increasingly demands individualized treatment-effect estimation in networks where interventions are high-dimensional, combinatorial vectors. While network interference, effect heterogeneity, and…

Methodology · Statistics 2026-02-24 Yunping Lu , Haoang Chi , Qirui Hu , Zhiheng Zhang

Whenever possible, the efficacy of a new treatment, such as a drug or behavioral intervention, is investigated by randomly assigning some individuals to a treatment condition and others to a control condition, and comparing the outcomes…

Methodology · Statistics 2015-05-04 Patrick C. Staples , Elizabeth L. Ogburn , Jukka-Pekka Onnela

In randomized experiments, the classic Stable Unit Treatment Value Assumption (SUTVA) posits that the outcome for one experimental unit is unaffected by the treatment assignments of other units. However, this assumption is frequently…

Methodology · Statistics 2024-11-18 Yiming Jiang , He Wang

This paper studies the problem of optimally allocating treatments in the presence of spillover effects, using information from a (quasi-)experiment. I introduce a method that maximizes the sample analog of average social welfare when…

Econometrics · Economics 2024-04-09 Davide Viviano

Two-sided marketplace platforms often run experiments to test the effect of an intervention before launching it platform-wide. A typical approach is to randomize individuals into the treatment group, which receives the intervention, and the…

Methodology · Statistics 2021-04-27 Hannah Li , Geng Zhao , Ramesh Johari , Gabriel Y. Weintraub

To minimize the mean squared error (MSE) in global average treatment effect (GATE) estimation under network interference, a popular approach is to use a cluster-randomized design. However, in the presence of homophily, which is common in…

Online A/B tests have become increasingly popular and important for social platforms. However, accurately estimating the global average treatment effect (GATE) has proven to be challenging due to network interference, which violates the…

Methodology · Statistics 2023-11-27 Qianyi Chen , Bo Li , Lu Deng , Yong Wang

In the context of cluster analysis and graph partitioning, many external evaluation measures have been proposed in the literature to compare two partitions of the same set. This makes the task of selecting the most appropriate measure for a…

Machine Learning · Computer Science 2021-02-09 Nejat Arinik , Vincent Labatut , Rosa Figueiredo

Influence propagation has been the subject of extensive study due to its important role in social networks, epidemiology, and many other areas. Understanding propagation mechanisms is critical to control the spread of fake news or…

Optimization and Control · Mathematics 2022-09-28 Vinicius Ferreira , Artur Pessoa , Thibaut Vidal

Most classification methods are based on the assumption that data conforms to a stationary distribution. The machine learning domain currently suffers from a lack of classification techniques that are able to detect the occurrence of a…

Machine Learning · Statistics 2012-01-05 Alzennyr Da Silva , Yves Lechevallier , Fabrice Rossi , Francisco De A. T. De Carvahlo

I introduce a simple permutation procedure to test conventional (non-sharp) hypotheses about the effect of a binary treatment in the presence of a finite number of large, heterogeneous clusters when the treatment effect is identified by…

Econometrics · Economics 2023-02-08 Andreas Hagemann

A/B tests serve the purpose of reliably identifying the effect of changes introduced in online services. It is common for online platforms to run a large number of simultaneous experiments by splitting incoming user traffic randomly in…

Machine Learning · Computer Science 2022-10-18 Alexander Buchholz , Vito Bellini , Giuseppe Di Benedetto , Yannik Stein , Matteo Ruffini , Fabian Moerchen

This paper studies inference in two-stage randomized experiments under covariate-adaptive randomization. In the initial stage of this experimental design, clusters (e.g., households, schools, or graph partitions) are stratified and randomly…

Econometrics · Economics 2026-01-16 Jizhou Liu

Online Controlled Experiments (OCEs) are the gold standard in evaluating the effectiveness of changes to websites. An important type of OCE evaluates different personalization strategies, which present challenges in low test power and lack…

Methodology · Statistics 2023-05-11 C. H. Bryan Liu , Emma J. McCoy

Randomized experiments, or A/B tests are used to estimate the causal impact of a feature on the behavior of users by creating two parallel universes in which members are simultaneously assigned to treatment and control. However, in social…

Social and Information Networks · Computer Science 2019-02-20 Craig Tutterow , Guillaume Saint-Jacques

Many interventions, such as vaccines in clinical trials or coupons in online marketplaces, must be assigned sequentially without full knowledge of their effects. Multi-armed bandit algorithms have proven successful in such settings.…

Machine Learning · Statistics 2026-05-07 Aidan Gleich , Eric Laber , Alexander Volfovsky