English
Related papers

Related papers: A/B testing under Interference with Partial Networ…

200 papers

Companies offering web services routinely run randomized online experiments to estimate the causal impact associated with the adoption of new features and policies on key performance metrics of interest. These experiments are used to…

Methodology · Statistics 2023-07-13 Lorenzo Masoero , Doug Hains , James McQueen

Network interference has attracted significant attention in the field of causal inference, encapsulating various sociological behaviors where the treatment assigned to one individual within a network may affect the outcomes of others, such…

Machine Learning · Computer Science 2025-02-11 Zhiheng Zhang , Zichen Wang

Heterogeneous treatment effects, which vary according to individual covariates, are crucial in fields such as personalized medicine and tailored treatment strategies. In many applications, rather than considering the heterogeneity induced…

Methodology · Statistics 2025-08-26 Peng Wu , Pengtao Zeng , Zhaoqing Tian , Shaojie Wei

Randomized experiments have become a cornerstone of evidence-based decision-making in contexts ranging from online platforms to public health. However, in experimental settings with network interference, a unit's treatment can influence…

Machine Learning · Computer Science 2025-10-22 Sadegh Shirani , Yuwei Luo , William Overman , Ruoxuan Xiong , Mohsen Bayati

In response to the growing need for generating real-world evidence from multi-site collaborative studies, we introduce an efficient collaborative learning approach to evaluate average treatment effect (ECO-ATE) in a multi-site setting under…

Methodology · Statistics 2026-04-09 Sijia Li , Rui Duan

For observational studies, we study the sensitivity of causal inference when treatment assignments may depend on unobserved confounders. We develop a loss minimization approach for estimating bounds on the conditional average treatment…

Methodology · Statistics 2022-03-11 Steve Yadlowsky , Hongseok Namkoong , Sanjay Basu , John Duchi , Lu Tian

Online media platforms often need to measure how frequently users are exposed to specific content attributes in order to evaluate trade-offs in A/B experiments. A direct approach is to sample content, label it using a high-quality rubric…

Applications · Statistics 2026-02-19 Zehao Xu , Tony Paek , Kevin O'Sullivan , Attila Dobi

The two-sample test is a fundamental problem in statistics with a wide range of applications. In the realm of high-dimensional data, nonparametric methods have gained prominence due to their flexibility and minimal distributional…

Methodology · Statistics 2024-12-24 Zexi Cai , Wenbo Fei , Doudou Zhou

Booming in business and a staple analysis in medical trials, the A/B test assesses the effect of an intervention or treatment by comparing its success rate with that of a control condition. Across many practical applications, it is…

Applications · Statistics 2020-11-16 Quentin F. Gronau , K. N. Akash Raj , Eric-Jan Wagenmakers

When interpreting A/B tests, we typically focus only on the statistically significant results and take them by face value. This practice, termed post-selection inference in the statistical literature, may negatively affect both point…

Applications · Statistics 2021-06-01 Alex Deng , Yicheng Li , Jiannan Lu , Vivek Ramamurthy

We consider estimation of the target population average treatment effect (TATE) when outcome information is unavailable. Instead, we observe the outcome in multiple source populations and wish to combine the treatment effects therein to…

Methodology · Statistics 2025-05-16 Zehao Su , Helene Charlotte Rytgaard , Henrik Ravn , Frank Eriksson

One of the major challenges in estimating conditional potential outcomes and conditional average treatment effects (CATE) is the presence of hidden confounders. Since testing for hidden confounders cannot be accomplished only with…

Machine Learning · Computer Science 2025-06-17 Ahmed Aloui , Juncheng Dong , Ali Hasan , Vahid Tarokh

Dropout is common in clinical studies, with up to half of patients leaving early due to side effects or other reasons. When dropout is informative (i.e., dependent on survival time), it introduces censoring bias, because of which treatment…

Machine Learning · Computer Science 2026-05-12 Yuxin Wang , Dennis Frauen , Jonas Schweisthal , Maresa Schröder , Stefan Feuerriegel

In this paper, we examine the biases that arise when firms run A/B tests on continuous parameters to estimate global treatment effects on performance metrics of interest; we particularly focus on price experiments to measure the price…

Methodology · Statistics 2026-01-22 Ramesh Johari , Orrie B. Page , Gabriel Y. Weintraub

Estimating how much an intervention helps a given individual the conditional average treatment effect (CATE) is increasingly central to decision-making in medicine, economics, and policy, where an estimate is most useful when accompanied by…

Machine Learning · Statistics 2026-05-28 Eichi Uehara

Randomized experiments are widely used to estimate causal effects across a variety of domains. However, classical causal inference approaches rely on critical independence assumptions that are violated by network interference, when the…

Methodology · Statistics 2022-10-18 Mayleen Cortez , Matthew Eichhorn , Christina Lee Yu

This paper studies inference in randomized controlled trials with covariate-adaptive randomization when there are multiple treatments. More specifically, we study inference about the average effect of one or more treatments relative to…

Econometrics · Economics 2019-01-21 Federico A. Bugni , Ivan A. Canay , Azeem M. Shaikh

We develop a theoretical framework for sample splitting in A/B testing environments, where data for each test are partitioned into two splits to measure methodological performance when the true impacts of tests are unobserved. We show that…

Econometrics · Economics 2026-03-24 Ryan Kessler , James McQueen , Miikka Rokkanen

We consider the problem of partial identification, the estimation of bounds on the treatment effects from observational data. Although studied using discrete treatment variables or in specific causal graphs (e.g., instrumental variables),…

Machine Learning · Computer Science 2022-10-18 Vahid Balazadeh , Vasilis Syrgkanis , Rahul G. Krishnan

The randomized controlled trial (RCT) is the gold standard for estimating the average treatment effect (ATE) of a medical intervention but requires 100s-1000s of subjects, making it expensive and difficult to implement. While a cross-over…

Signal Processing · Electrical Eng. & Systems 2023-05-10 Sayeri Lala , Niraj K. Jha