English
Related papers

Related papers: A framework for Multi-A(rmed)/B(andit) testing wit…

200 papers

Restless Multi-Armed Bandits (RMABs) are a powerful framework for sequential decision-making, widely applied in resource allocation and intervention optimization challenges in public health. However, traditional RMABs assume independence…

Machine Learning · Computer Science 2025-12-09 Hanmo Zhang , Zenghui Sun , Kai Wang

We propose a nonparametric sequential test that aims to address two practical problems pertinent to online randomized experiments: (i) how to do a hypothesis test for complex metrics; (ii) how to prevent type $1$ error inflation under…

Machine Learning · Statistics 2017-06-28 Vineet Abhishek , Shie Mannor

False discovery rate (FDR) has been widely used as an error measure in large scale multiple testing problems, but most research in the area has been focused on procedures for controlling the FDR based on independent test statistics or the…

Methodology · Statistics 2009-09-29 Weihua Tang , Cun-Hui Zhang

Simultaneous statistical inference has been a cornerstone in the statistics methodology literature because of its fundamental theory and paramount applications. The mainstream multiple testing literature has traditionally considered two…

Statistics Theory · Mathematics 2025-03-21 Monitirtha Dey , Subir Kumar Bhandari

False discovery rate (FDR) has been a key metric for error control in multiple hypothesis testing, and many methods have developed for FDR control across a diverse cross-section of settings and applications. We develop a closure principle…

Methodology · Statistics 2025-09-04 Ziyu Xu , Lasse Fischer , Aaditya Ramdas

Obtaining high-quality labels for large datasets is expensive, requiring massive annotations from human experts. While AI models offer a cost-effective alternative by predicting labels, their label quality is compromised by the unavoidable…

Machine Learning · Computer Science 2026-02-17 Huipeng Huang , Wenbo Liao , Huajun Xi , Hao Zeng , Mengchen Zhao , Hongxin Wei

The gold standard for estimating causal effects is randomized controlled trial (RCT) or A/B testing where a random group of individuals from a population of interest are given treatment and the outcome is compared to a random group of…

Machine Learning · Computer Science 2025-05-09 Ahmed Sayeed Faruk , Jason Sulskis , Elena Zheleva

Active-controlled trials with non-inferiority objectives are often used when effective interventions are available, but new options may offer advantages or meet public health needs. In these trials, participants are randomized to an…

Methodology · Statistics 2025-10-28 Antonio Olivas-Martinez , Fei Gao , Holly Janes

The mitigation of false positives is an important issue when conducting multiple hypothesis testing. The most popular paradigm for false positives mitigation in high-dimensional applications is via the control of the false discovery rate…

Methodology · Statistics 2018-07-17 Hien D. Nguyen , Yohan Yee , Geoffrey J. McLachlan , Jason P. Lerch

Multiple testing problems arising in modern scientific applications can involve simultaneously testing thousands or even millions of hypotheses, with relatively few true signals. In this paper, we consider the multiple testing problem where…

Methodology · Statistics 2016-06-28 Ang Li , Rina Foygel Barber

In many practical applications of multiple hypothesis testing using the False Discovery Rate (FDR), the given hypotheses can be naturally partitioned into groups, and one may not only want to control the number of false discoveries (wrongly…

Methodology · Statistics 2016-11-01 Rina Foygel Barber , Aaditya Ramdas

Federated multi-armed bandits (FMAB) is a new bandit paradigm that parallels the federated learning (FL) framework in supervised learning. It is inspired by practical applications in cognitive radio and recommender systems, and enjoys…

Machine Learning · Computer Science 2021-03-04 Chengshuai Shi , Cong Shen

Multi-armed bandits (MAB) is a sequential decision-making model in which the learner controls the trade-off between exploration and exploitation to maximize its cumulative reward. Federated multi-armed bandits (FMAB) is an emerging…

Machine Learning · Computer Science 2025-02-18 Artun Saday , İlker Demirel , Yiğit Yıldırım , Cem Tekin

A/B testing, a widely used form of Randomized Controlled Trial (RCT), is a fundamental tool in business data analysis and experimental design. However, despite its intent to maintain randomness, A/B testing often faces challenges that…

Methodology · Statistics 2024-08-13 Zihao Zheng , Carol Liu

We study the problem of online clustering of data sequences in the multi-armed bandit (MAB) framework under the fixed-confidence setting. There are $M$ arms, each providing i.i.d. samples from a parametric distribution whose parameters are…

Machine Learning · Computer Science 2026-03-23 G Dhinesh Chandran , Srinivas Reddy Kota , Srikrishna Bhashyam

Multi-function radars (MFRs) are sophisticated types of sensors with the capabilities of complex agile inter-pulse modulation implementation and dynamic work mode scheduling. The developments in MFRs pose great challenges to modern…

Signal Processing · Electrical Eng. & Systems 2023-08-23 Jiadi Bao , Yunjie Li , Mengtao Zhu , Shafei Wang

Safety assessment plays a fundamental role in developing a new drug via clinical trials for ethical considerations. Due to complexity, manual review is typically conducted on the totality of data to draw safety conclusions. There are some…

Applications · Statistics 2026-05-06 Tianyu Zhan , Yabing Mai , Yihua Gu , Thao Doan , Xun Chen

The multi-armed bandit (MAB) model has been widely adopted for studying many practical optimization problems (network resource allocation, ad placement, crowdsourcing, etc.) with unknown parameters. The goal of the player here is to…

Machine Learning · Computer Science 2019-11-21 Fengjiao Li , Jia Liu , Bo Ji

Online platforms routinely compare multi-armed bandit algorithms, such as UCB and Thompson Sampling, to select the best-performing policy. Unlike standard A/B tests for static treatments, each run of a bandit algorithm over $T$ users…

Machine Learning · Computer Science 2026-04-14 Huiling Meng , Ningyuan Chen , Xuefeng Gao

Response adaptive randomization (RAR) is appealing from methodological, ethical, and pragmatic perspectives in the sense that subjects are more likely to be randomized to better performing treatment groups based on accumulating data.…

Methodology · Statistics 2022-08-03 Tianyu Zhan , Lu Cui , Ziqian Geng , Lanju Zhang , Yihua Gu , Ivan S. F. Chan