English
Related papers

Related papers: Cluster-Adaptive Network A/B Testing: From Randomi…

200 papers

Mean Shift today, is widely used for mode detection and clustering. The technique though, is challenged in practice due to assumptions of isotropicity and homoscedasticity. We present an adaptive Mean Shift methodology that allows for full…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Rahul Sawhney , Henrik I. Christensen , Gary R. Bradski

In online randomized experiments or A/B tests, accurate predictions of participant inclusion rates are of paramount importance. These predictions not only guide experimenters in optimizing the experiment's duration but also enhance the…

Methodology · Statistics 2024-02-06 Lorenzo Masoero , Mario Beraha , Thomas Richardson , Stefano Favaro

This paper presents a clustering approach that allows for rigorous statistical error control similar to a statistical test. We develop estimators for both the unknown number of clusters and the clusters themselves. The estimators depend on…

Statistics Theory · Mathematics 2017-07-13 Michael Vogt , Matthias Schmid

In a clustered observational study, a treatment is assigned to groups and all units within the group are exposed to the treatment. We develop a new method for statistical adjustment in clustered observational studies using approximate…

Methodology · Statistics 2023-03-06 Luke Keele , Eli Ben-Michael , Lindsay Page

This paper considers inference when there is a single treated cluster and a fixed number of control clusters, a setting that is common in empirical work, especially in difference-in-differences designs. We use the t-statistic and develop…

Econometrics · Economics 2025-11-11 Chun Pong Lau , Xinran Li

This paper studies inference in two-stage randomized experiments under covariate-adaptive randomization. In the initial stage of this experimental design, clusters (e.g., households, schools, or graph partitions) are stratified and randomly…

Econometrics · Economics 2026-01-16 Jizhou Liu

Online evaluation of machine learning models is typically conducted through A/B experiments. Sequential statistical tests are valuable tools for analysing these experiments, as they enable researchers to stop data collection early without…

Methodology · Statistics 2025-10-08 Alexey Kurennoy , Majed Dodin , Tural Gurbanov , Ana Peleteiro Ramallo

Adaptive interventions, aka dynamic treatment regimens, are sequences of pre-specified decision rules that guide the provision of treatment for an individual given information about their baseline and evolving needs, including in response…

Methodology · Statistics 2024-05-02 Wenchu Pan , Daniel Almirall , Amy M. Kilbourne , Andrew Quanbeck , Lu Wang

Randomized controlled trials (RCTs) often suffer from limited inferential efficiency in estimating treatment effects due to their small sample sizes. In recent years, incorporating external controls (ECs) has gained increasing attention as…

Methodology · Statistics 2026-04-16 Qinwei Yang , Jingyi Li , Peng Wu , Shu Yang

Randomized experiments are the gold standard for estimating the average treatment effect (ATE). While covariate adjustment can reduce the asymptotic variances of the unbiased Horvitz-Thompson estimators for the ATE, it suffers from…

Methodology · Statistics 2025-08-22 Xin Lu , Lei Shi , Hanzhong Liu , Peng Ding

The weighted average treatment effect (WATE) is a causal measure for the comparison of interventions in a specific target population, which may be different from the population where data are sampled from. For instance, when the goal is to…

Methodology · Statistics 2018-04-17 Yebin Tao , Haoda Fu

Clustering algorithms are pivotal in data analysis, enabling the organization of data into meaningful groups. However, individual clustering methods often exhibit inherent limitations and biases, preventing the development of a universal…

Neural and Evolutionary Computing · Computer Science 2024-12-13 H. Jahani , F. Zamio

Network data have appeared frequently in recent research. For example, in comparing the effects of different types of treatment, network models have been proposed to improve the quality of estimation and hypothesis testing. In this paper,…

Methodology · Statistics 2020-09-04 Zhixin Zhou , Ping Li , Feifang Hu

Computerized Adaptive Testing (CAT) is a widely used technology for evaluating learners' proficiency in online education platforms. By leveraging prior estimates of proficiency to select questions and updating the estimates iteratively…

Information Retrieval · Computer Science 2025-12-24 Mi Tian , Kun Zhang , Fei Liu , Jinglong Li , Yuxin Liao , Chenxi Bai , Zhengtao Tan , Le Wu , Richang Hong

Software companies have widely used online A/B testing to evaluate the impact of a new technology by offering it to groups of users and comparing it against the unmodified product. However, running online A/B testing needs not only efforts…

Software Engineering · Computer Science 2024-08-12 Jie JW Wu

A clustered adaptive intervention (cAI) is a pre-specified sequence of decision rules that guides practitioners on how best - and based on which measures - to tailor cluster-level intervention to improve outcomes at the level of individuals…

Methodology · Statistics 2025-05-05 Yao Song , Kelly Speth , Amy Kilbourne , Andrew Quanbeck , Daniel Almirall , Lu Wang

We consider the estimation of heterogeneous treatment effects with arbitrary machine learning methods in the presence of unobserved confounders with the aid of a valid instrument. Such settings arise in A/B tests with an intent-to-treat…

Econometrics · Economics 2019-06-07 Vasilis Syrgkanis , Victor Lei , Miruna Oprescu , Maggie Hei , Keith Battocchi , Greg Lewis

Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…

Machine Learning · Computer Science 2025-07-29 Ahmed Shokry , Ayman Khalafallah

Adversarial attack perturbs an image with an imperceptible noise, leading to incorrect model prediction. Recently, a few works showed inherent bias associated with such attack (robustness bias), where certain subgroups in a dataset (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Gaurav Kumar Nayak , Ruchit Rawal , Rohit Lal , Himanshu Patil , Anirban Chakraborty

The standard A/B testing approaches are mostly based on t-test in large scale industry applications. These standard approaches however suffers from low statistical power in business settings, due to nature of small sample-size or…

Methodology · Statistics 2025-12-30 Changshuai Wei , Phuc Nguyen , Benjamin Zelditch , Joyce Chen