English
Related papers

Related papers: A/B testing under Interference with Partial Networ…

200 papers

The conditional average treatment effect (CATE) is frequently estimated to refute the homogeneous treatment effect assumption. Under this assumption, all units making up the population under study experience identical benefit from a given…

Social networks play a key role in studying various individual and social behaviors. To use social networks in a study, their structural properties must be measured. For offline social networks, the conventional procedure is…

Social and Information Networks · Computer Science 2018-12-17 Naghmeh Momeni , Michael G. Rabbat

Online controlled experiments, colloquially known as A/B-tests, are the bread and butter of real-world recommender system evaluation. Typically, end-users are randomly assigned some system variant, and a plethora of metrics are then…

Information Retrieval · Computer Science 2024-07-31 Olivier Jeunen , Shubham Baweja , Neeti Pokharna , Aleksei Ustimenko

In data centers, tasks are dispatched to various servers to evenly distribute the workload. When a data center considers implementing a new scheduling algorithm, it typically conducts an A/B test prior to deployment to assess the real-world…

Methodology · Statistics 2026-05-29 Nanshan Jia , Ramesh Johari , Nian Si , Zeyu Zheng

We consider the estimation of heterogeneous treatment effects with arbitrary machine learning methods in the presence of unobserved confounders with the aid of a valid instrument. Such settings arise in A/B tests with an intent-to-treat…

Econometrics · Economics 2019-06-07 Vasilis Syrgkanis , Victor Lei , Miruna Oprescu , Maggie Hei , Keith Battocchi , Greg Lewis

We give an approach for characterizing interference by lower bounding the number of units whose outcome depends on selected groups of treated individuals, such as depending on the treatment of others, or others who are at least a certain…

Methodology · Statistics 2025-11-04 David Choi

We investigate large-sample properties of treatment effect estimators under unknown interference in randomized experiments. The inferential target is a generalization of the average treatment effect estimand that marginalizes over potential…

Statistics Theory · Mathematics 2019-10-25 Fredrik Sävje , Peter M. Aronow , Michael G. Hudgens

Although the interest in the the use of social and information networks has grown, most inferences on networks assume the data collected represents the complete. However, when ignoring missing data, even when missing completely at random,…

Methodology · Statistics 2022-03-25 Tyler Vu , Tuo Lin , Jingjing Zou , Vladimir Novitsky , Xin Tu , Victor De Gruttola

We propose an easy-to-use adjustment estimator for the effect of a treatment based on observational data from a single (social) network of units. The approach allows for interactions among units within the network, called interference, and…

Methodology · Statistics 2023-12-06 Meta-Lina Spohn , Leonard Henckel , Marloes H. Maathuis

The average treatment effect can obscure important heterogeneity when individuals respond differently to a treatment. While the conditional average treatment effect (CATE) function captures such heterogeneity, it is difficult to communicate…

Methodology · Statistics 2026-05-18 Anders Munch , Thomas A. Gerds

A network effect is said to take place when a new feature not only impacts the people who receive it, but also other users of the platform, like their connections or the people who follow them. This very common phenomenon violates the…

Social and Information Networks · Computer Science 2019-03-22 Guillaume Saint-Jacques , Maneesh Varshney , Jeremy Simpson , Ya Xu

Instrumental variables (IVs) are widely used for estimating causal effects in the presence of unmeasured confounding. Under the standard IV model, however, the average treatment effect (ATE) is only partially identifiable. To address this,…

Methodology · Statistics 2018-01-08 Linbo Wang , Eric Tchetgen Tchetgen

This paper introduces an overidentification test of two alternative assumptions to identify the average treatment effect on the treated in a two-period panel data setting: unconfoundedness and common trends. Under the unconfoundedness…

Econometrics · Economics 2024-06-25 Martin Huber , Eva-Maria Oeß

In experiments that study social phenomena, such as peer influence or herd immunity, the treatment of one unit may influence the outcomes of others. Such "interference between units" violates traditional approaches for causal inference, so…

Methodology · Statistics 2023-08-30 David Choi

We study the problem of learning conditional average treatment effects (CATE) from high-dimensional, observational data with unobserved confounders. Unobserved confounders introduce ignorance -- a level of unidentifiability -- about an…

Machine Learning · Computer Science 2022-02-02 Andrew Jesson , Sören Mindermann , Yarin Gal , Uri Shalit

We propose a new framework for online testing of heterogeneous treatment effects. The proposed test, named sequential score test (SST), is able to control type I error under continuous monitoring and detect multi-dimensional heterogeneous…

Methodology · Statistics 2020-02-11 Miao Yu , Wenbin Lu , Rui Song

The popularity of online surveys has increased the prominence of using weights that capture units' probabilities of inclusion for claims of representativeness. Yet, much uncertainty remains regarding how these weights should be employed in…

Methodology · Statistics 2017-08-16 Luke W. Miratrix , Jasjeet S. Sekhon , Alexander G. Theodoridis , Luis F. Campos

A fundamental limitation of causal inference in observational studies is that perceived evidence for an effect might instead be explained by factors not accounted for in the primary analysis. Methods for assessing the sensitivity of a…

Methodology · Statistics 2018-09-14 Colin B. Fogarty

Anomaly detection has been considered under several extents of prior knowledge. Unsupervised methods do not require any labelled data, whereas semi-supervised methods leverage some known anomalies. Inspired by mixture-of-experts models and…

Machine Learning · Computer Science 2022-10-14 J. -P. Schulze , P. Sperl , K. Böttinger

In online randomized experiments or A/B tests, accurate predictions of participant inclusion rates are of paramount importance. These predictions not only guide experimenters in optimizing the experiment's duration but also enhance the…

Methodology · Statistics 2024-02-06 Lorenzo Masoero , Mario Beraha , Thomas Richardson , Stefano Favaro