English
Related papers

Related papers: The Power of Batching in Multiple Hypothesis Testi…

200 papers

The recent e-Benjamini-Hochberg (e-BH) procedure for multiple hypothesis testing is known to control the false discovery rate (FDR) under arbitrary dependence between the input e-values. This paper points out an important subtlety when…

Methodology · Statistics 2025-08-06 Hongjian Wang , Sanjit Dandapanthula , Aaditya Ramdas

When hypotheses are tested in a stream and real-time decision-making is needed, online sequential hypothesis testing procedures are needed. Furthermore, these hypotheses are commonly partitioned into groups by their nature. For example, the…

Methodology · Statistics 2025-06-05 Runqiu Wang , Ran Dai

In the online multiple testing problem, p-values corresponding to different null hypotheses are observed one by one, and the decision of whether or not to reject the current hypothesis must be made immediately, after which the next p-value…

Methodology · Statistics 2017-10-03 Aaditya Ramdas , Fanny Yang , Martin J. Wainwright , Michael I. Jordan

The introduction of the false discovery rate (FDR) by Benjamini and Hochberg has spurred a great interest in developing methodologies to control the FDR in various settings. The majority of existing approaches, however, address the FDR…

Methodology · Statistics 2016-06-09 Kasra Alishahi , Ahmad Reza Ehyaei , Ali Shojaie

This work concerns controlling the false discovery rate (FDR) in networks under communication constraints. We present sample-and-forward, a flexible and communication-efficient version of the Benjamini-Hochberg (BH) procedure for multihop…

Signal Processing · Electrical Eng. & Systems 2023-05-17 Mehrdad Pournaderi , Yu Xiang

In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in…

Methodology · Statistics 2017-09-14 Ang Li , Rina Foygel Barber

In hypothesis testing, a false discovery occurs when a hypothesis is incorrectly rejected due to noise in the sample. When adaptively testing multiple hypotheses, the probability of a false discovery increases as more tests are performed.…

Machine Learning · Statistics 2020-10-22 Wanrong Zhang , Gautam Kamath , Rachel Cummings

We derive new algorithms for online multiple testing that provably control false discovery exceedance (FDX) while achieving orders of magnitude more power than previous methods. This statistical advance is enabled by the development of new…

Methodology · Statistics 2021-06-03 Ziyu Xu , Aaditya Ramdas

False discovery rate (FDR) has been a key metric for error control in multiple hypothesis testing, and many methods have developed for FDR control across a diverse cross-section of settings and applications. We develop a closure principle…

Methodology · Statistics 2025-09-04 Ziyu Xu , Lasse Fischer , Aaditya Ramdas

This analysis report presents an in-depth exploration of multiple hypothesis testing in the context of Genomics RNA-seq differential expression (DE) analysis, with a primary focus on techniques designed to control the false discovery rate…

Methodology · Statistics 2025-07-01 Shyam Gupta

Multiple hypothesis testing with false discovery rate (FDR) control is a fundamental problem in statistical inference, with broad applications in genomics, drug screening, and outlier detection. In many such settings, researchers may have…

Methodology · Statistics 2026-02-19 Yonghoon Lee , Meshi Bashari , Edgar Dobriban , Yaniv Romano

In many scientific applications, hypotheses are generated and tested continuously in a stream. We develop a framework for improving online multiple testing procedures with false discovery rate (FDR) control under arbitrary dependence. Our…

Methodology · Statistics 2026-03-27 Ziyu Xu , Lasse Fischer , Aaditya Ramdas

Multiple hypothesis testing is a central topic in statistics, but despite abundant work on the false discovery rate (FDR) and the corresponding Type-II error concept known as the false non-discovery rate (FNR), a fine-grained understanding…

Statistics Theory · Mathematics 2017-05-17 Maxim Rabinovich , Aaditya Ramdas , Michael I. Jordan , Martin J. Wainwright

Multiple tests are designed to test a whole collection of null hypotheses simultaneously. Their quality is often judged by the false discovery rate (FDR), i.e. the expectation of the quotient of the number of false rejections divided by the…

Statistics Theory · Mathematics 2015-11-24 Julia Benditkis , Philipp Heesen , Arnold Janssen

To find interesting items in genome-wide association studies or next generation sequencing data, a crucial point is to design powerful false discovery rate (FDR) controlling procedures that suitably combine discrete tests (typically…

Statistics Theory · Mathematics 2017-09-18 Sebastian Döhler , Guillermo Durand , Etienne Roquain

When testing multiple hypotheses, a suitable error rate should be controlled even in exploratory trials. Conventional methods to control the False Discovery Rate (FDR) assume that all p-values are available at the time point of test…

Methodology · Statistics 2021-12-21 Sonja Zehetmayer , Martin Posch , Franz Koenig

Differential privacy provides a rigorous framework for privacy-preserving data analysis. This paper proposes the first differentially private procedure for controlling the false discovery rate (FDR) in multiple hypothesis testing. Inspired…

Statistics Theory · Mathematics 2021-07-06 Cynthia Dwork , Weijie J. Su , Li Zhang

We address a common problem in large-scale data analysis, and especially the field of genetics, the huge-scale testing problem, where millions to billions of hypotheses are tested together creating a computational challenge to perform…

Methodology · Statistics 2015-01-22 Vered Madar , Sandra Batista

We propose a novel multiple testing methodology for controlling the false discovery rate (FDR) in high-dimensional linear models that integrates model-X knockoff techniques with debiased penalized regression estimators. At the foundation of…

Methodology · Statistics 2026-03-17 Jinyuan Chang , Chenlong Li , Cheng Yong Tang , Zhengtian Zhu

This paper develops a general framework for controlling the false discovery rate (FDR) in multiple testing of Gaussian means against two-sided alternatives. The widely used Benjamini-Hochberg (BH) procedure provides exact FDR control under…

Methodology · Statistics 2025-11-26 Deepra Ghosh , Sanat K. Sarkar