English
Related papers

Related papers: Online multiple hypothesis testing

200 papers

We propose a new framework for online testing of heterogeneous treatment effects. The proposed test, named sequential score test (SST), is able to control type I error under continuous monitoring and detect multi-dimensional heterogeneous…

Methodology · Statistics 2020-02-11 Miao Yu , Wenbin Lu , Rui Song

In this work we study an adaptive step-down procedure for testing $m$ hypotheses. It stems from the repeated use of the false discovery rate controlling the linear step-up procedure (sometimes called BH), and makes use of the critical…

Statistics Theory · Mathematics 2009-04-01 Yulia Gavrilov , Yoav Benjamini , Sanat K. Sarkar

This paper designs methods for decentralized multiple hypothesis testing on graphs that are equipped with provable guarantees on the false discovery rate (FDR). We consider the setting where distinct agents reside on the nodes of an…

Methodology · Statistics 2025-07-08 Aaditya Ramdas , Jianbo Chen , Martin J. Wainwright , Michael I. Jordan

We present a novel necessary and sufficient principle for False Discovery Rate (FDR) control. This e-Partitioning Principle says that a procedure controls FDR if and only if it is a special case of a general e-Partitioning procedure. By…

Statistics Theory · Mathematics 2025-09-15 Jelle Goeman , Rianne de Heide , Aldo Solari

In the high dimensional regression analysis when the number of predictors is much larger than the sample size, an important question is to select the important variable which are relevant to the response variable of interest. Variable…

Methodology · Statistics 2023-01-09 Pengsheng Ji , Zhigen Zhao

Inequalities are key tools to prove FDR control of a multiple test. The present paper studies upper and lower bounds for the FDR under various dependence structures of p-values, namely independence, reverse martingale dependence and…

Statistics Theory · Mathematics 2015-02-18 Philipp Heesen , Arnold Janssen

Negative control is a common technique in scientific investigations and broadly refers to the situation where a null effect (''negative result'') is expected. Motivated by a real proteomic dataset, we will present three promising and…

Methodology · Statistics 2023-03-21 Zijun Gao , Qingyuan Zhao

Many important tasks of large-scale recommender systems can be naturally cast as testing multiple linear forms for noisy matrix completion. These problems, however, present unique challenges because of the subtle bias-and-variance tradeoff…

Methodology · Statistics 2025-03-12 Wanteng Ma , Lilun Du , Dong Xia , Ming Yuan

Modern statisticians are often presented with hundreds or thousands of hypothesis testing problems to evaluate at the same time, generated from new scientific technologies such as microarrays, medical and satellite imaging devices, or flow…

Applications · Statistics 2008-12-18 Bradley Efron

This paper explores the intrinsic connections between the Bayesian false discovery rate (FDR) control procedures and their counterpart of frequentist procedures. We attempt to offer a unified view of FDR control within and beyond the…

Methodology · Statistics 2018-03-15 Xiaoquan Wen

There is a significant literature on methods for incorporating knowledge into multiple testing procedures so as to improve their power and precision. Some common forms of prior knowledge include (a) beliefs about which hypotheses are null,…

Methodology · Statistics 2019-08-07 Aaditya Ramdas , Rina Foygel Barber , Martin J. Wainwright , Michael I. Jordan

This paper introduces a novel multi-stage decision-making model that integrates hypothesis testing and dynamic programming algorithms to address complex decision-making scenarios.Initially,we develop a sampling inspection scheme that…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Ziyang Liu , Yurui Hu , Yihan Deng

Multiple testing is an important research area with widespread scientific applications, including in biology and neuroscience. Among popularly adopted multiple testing procedures, many are based on p-values or Local false discovery rate…

Methodology · Statistics 2025-06-26 Shenghao Qin , Bowen Gang , Yin Xia

While traditional multiple testing procedures prohibit adaptive analysis choices made by users, Goeman and Solari (2011) proposed a simultaneous inference framework that allows users such flexibility while preserving high-probability bounds…

Statistics Theory · Mathematics 2021-01-05 Eugene Katsevich , Aaditya Ramdas

In large-scale multiple hypothesis testing problems, the false discovery exceedance (FDX) provides a desirable alternative to the widely used false discovery rate (FDR) when the false discovery proportion (FDP) is highly variable. We…

Methodology · Statistics 2023-04-21 Pallavi Basu , Luella Fu , Alessio Saretto , Wenguang Sun

We propose a novel methodology for discovering the presence of relationships realized as binary time series between variables in high dimension. To make it visually intuitive, we regard the existence of a relationship as an edge connection,…

Methodology · Statistics 2024-10-07 Masaki Toyoda , Yoshimasa Uematsu

Efforts to develop more efficient multiple hypothesis testing procedures for false discovery rate (FDR) control have focused on incorporating an estimate of the proportion of true null hypotheses (such procedures are called adaptive) or…

Methodology · Statistics 2017-02-13 Joshua D. Habiger

Multiple testing with discrete p-values routinely arises in various scientific endeavors. However, procedures, including the false discovery rate (FDR) controlling Benjamini-Hochberg (BH) procedure, often used in such settings, being…

Methodology · Statistics 2019-06-06 Xiongzhi Chen , Sanat K. Sarkar

Null Hypothesis Significance Testing is the \textit{de facto} tool for assessing effectiveness differences between Information Retrieval systems. Researchers use statistical tests to check whether those differences will generalise to online…

Information Retrieval · Computer Science 2025-07-23 David Otero , Javier Parapar , Álvaro Barreiro

The use of weights provides an effective strategy to incorporate prior domain knowledge in large-scale inference. This paper studies weighted multiple testing in a decision-theoretic framework. We develop oracle and data-driven procedures…

Methodology · Statistics 2017-05-10 Pallavi Basu , T. Tony Cai , Kiranmoy Das , Wenguang Sun