中文
相关论文

相关论文: A framework for Multi-A(rmed)/B(andit) testing wit…

200 篇论文

Online restless multi-armed bandits (RMABs) typically assume that each arm follows a stationary Markov Decision Process (MDP) with fixed state transitions and rewards. However, in real-world applications like healthcare and recommendation…

机器学习 · 计算机科学 2025-08-15 Yu-Heng Hung , Ping-Chun Hsieh , Kai Wang

The multiple testing procedure plays an important role in detecting the presence of spatial signals for large-scale imaging data. Typically, the spatial signals are sparse but clustered. This paper provides empirical evidence that for a…

统计理论 · 数学 2011-03-11 Chunming Zhang , Jianqing Fan , Tao Yu

Efforts to develop more efficient multiple hypothesis testing procedures for false discovery rate (FDR) control have focused on incorporating an estimate of the proportion of true null hypotheses (such procedures are called adaptive) or…

统计方法学 · 统计学 2017-02-13 Joshua D. Habiger

Controlling the false discovery rate (FDR) in high-dimensional variable selection requires balancing rigorous error control with statistical power. Existing methods with provable guarantees are often overly conservative, creating a…

统计方法学 · 统计学 2026-02-06 Arnau Vilella , Jasin Machkour , Michael Muma , Daniel P. Palomar

This work investigates multiple testing by considering minimax separation rates in the sparse sequence model, when the testing risk is measured as the sum FDR+FNR (False Discovery Rate plus False Negative Rate). First using the popular…

统计理论 · 数学 2023-08-31 Kweku Abraham , Ismael Castillo , Etienne Roquain

Multi-armed bandit (MAB) processes constitute a foundational subclass of reinforcement learning problems and represent a central topic in statistical decision theory, but are limited to simultaneous adaptive allocation and sequential test,…

统计方法学 · 统计学 2026-02-27 Li Yang , Xiaodong Yan , Dandan Jiang

While traditional multiple testing procedures prohibit adaptive analysis choices made by users, Goeman and Solari (2011) proposed a simultaneous inference framework that allows users such flexibility while preserving high-probability bounds…

统计理论 · 数学 2021-01-05 Eugene Katsevich , Aaditya Ramdas

With the extensive use of digital devices, online experimental platforms are commonly used to conduct experiments to collect data for evaluating different variations of products, algorithms, and interface designs, a.k.a., A/B tests. In…

统计方法学 · 统计学 2024-07-09 Qiong Zhang , Lulu Kang , Xinwei Deng

Experimentation is crucial for managers to rigorously quantify the value of a change and determine if it leads to a statistically significant improvement over the status quo. As companies increasingly mandate that all changes undergo…

统计方法学 · 统计学 2024-10-16 Biyonka Liang , Iavor Bojinov

Large-scale hypothesis testing is central to modern science, where controlling the False Discovery Rate (FDR) has become the standard approach to managing false positives across many simultaneous tests. Hypotheses rarely exist in isolation;…

统计方法学 · 统计学 2026-05-19 Binyamin Perets , Shie Mannor

Heteroskedasticity poses several methodological challenges in designing valid and powerful procedures for simultaneous testing of composite null hypotheses. In particular, the conventional practice of standardizing or re-scaling…

统计方法学 · 统计学 2025-09-04 Bowen Gang , Trambak Banerjee

This paper describes REALab, a platform for embedded agency research in reinforcement learning (RL). REALab is designed to model the structure of tampering problems that may arise in real-world deployments of RL. Standard Markov Decision…

机器学习 · 计算机科学 2020-11-18 Ramana Kumar , Jonathan Uesato , Richard Ngo , Tom Everitt , Victoria Krakovna , Shane Legg

Online controlled experiments, now commonly known as A/B testing, are crucial to causal inference and data driven decision making in many internet based businesses. While a simple comparison between a treatment (the feature under test) and…

应用统计 · 统计学 2015-01-05 Yu Guo , Alex Deng

We consider a variant of sequential testing by betting where, at each time step, the statistician is presented with multiple data sources (arms) and obtains data by choosing one of the arms. We consider the composite global null hypothesis…

统计方法学 · 统计学 2026-03-19 Ricardo J. Sandoval , Ian Waudby-Smith , Michael I. Jordan

The false discovery rate (FDR) and the false non-discovery rate (FNR), defined as the expected false discovery proportion (FDP) and the false non-discovery proportion (FNP), are the most popular benchmarks for multiple testing. Despite the…

统计理论 · 数学 2025-09-03 Yutong Nie , Yihong Wu

Analyzing large-scale, multi-experiment studies requires scientists to test each experimental outcome for statistical significance and then assess the results as a whole. We present Black Box FDR (BB-FDR), an empirical-Bayes method for…

机器学习 · 统计学 2018-06-11 Wesley Tansey , Yixin Wang , David M. Blei , Raul Rabadan

Balancing false discovery rate (FDR) control with high statistical power remains a central challenge in high-dimensional variable selection. While several FDR-controlling methods have been proposed, many degrade the original data -- by…

统计方法学 · 统计学 2025-07-16 Changhu Wang , Ziheng Zhang , Jingyi Jessica Li

We propose a general framework based on selectively traversed accumulation rules (STAR) for interactive multiple testing with generic structural constraints on the rejection set. It combines accumulation tests from ordered multiple testing…

统计方法学 · 统计学 2020-09-08 Lihua Lei , Aaditya Ramdas , William Fithian

The steep rise in availability and usage of high-throughput technologies in biology brought with it a clear need for methods to control the False Discovery Rate (FDR) in multiple tests. Benjamini and Hochberg (BH) introduced in 1995 a…

统计方法学 · 统计学 2011-08-11 Amit Zeisel , Or Zuk , Eytan Domany

The traditional approaches to false discovery rate (FDR) control in multiple hypothesis testing are usually based on the null distribution of a test statistic. However, all types of null distributions, including the theoretical,…

统计方法学 · 统计学 2021-04-13 Kun He , Mengjie Li , Yan Fu , Fuzhou Gong , Xiaoming Sun