English
Related papers

Related papers: False discovery rate control with compound p-value…

200 papers

The highly influential two-group model in testing a large number of statistical hypotheses assumes that the test statistics are drawn independently from a mixture of a high probability null distribution and a low probability alternative.…

Methodology · Statistics 2020-12-08 Ruth Heller , Saharon Rosset

Testing for differences in features between clusters in various applications often leads to inflated false positives when practitioners use the same dataset to identify clusters and then test features, an issue commonly known as ``double…

Methodology · Statistics 2024-10-10 Lijun Wang , Yingxin Lin , Hongyu Zhao

In contemporary problems involving genetic or neuroimaging data, thousands of hypotheses need to be tested. Due to their high power, and finite sample guarantees on type-I error under weak assumptions, Monte Carlo permutation tests are…

Methodology · Statistics 2025-09-01 Lasse Fischer , Timothy Barry , Aaditya Ramdas

In modern multiple hypothesis testing, the availability of covariate information alongside the primary test statistics has motivated the development of more powerful and adaptive inference methods. However, most existing approaches rely on…

Methodology · Statistics 2025-11-20 Taehyoung Kim , Seohwa Hwang , Junyong Park

Controlled variable selection is an important analytical step in various scientific fields, such as brain imaging or genomics. In these high-dimensional data settings, considering too many variables leads to poor models and high costs,…

Methodology · Statistics 2023-10-17 Alexandre Blain , Bertrand Thirion , Olivier Grisel , Pierre Neuvial

When testing multiple hypotheses, a suitable error rate should be controlled even in exploratory trials. Conventional methods to control the False Discovery Rate (FDR) assume that all p-values are available at the time point of test…

Methodology · Statistics 2021-12-21 Sonja Zehetmayer , Martin Posch , Franz Koenig

We explicitly define the notions of (bona fide, approximate or asymptotic) compound p-values and e-values, which have been implicitly presented and used in the recent multiple testing literature. While it is known that the e-BH procedure…

Methodology · Statistics 2025-07-24 Nikolaos Ignatiadis , Ruodu Wang , Aaditya Ramdas

We propose a novel methodology for discovering the presence of relationships realized as binary time series between variables in high dimension. To make it visually intuitive, we regard the existence of a relationship as an edge connection,…

Methodology · Statistics 2024-10-07 Masaki Toyoda , Yoshimasa Uematsu

One important partition of algorithms for controlling the false discovery rate (FDR) in multiple testing is into offline and online algorithms. The first generally achieve significantly higher power of discovery, while the latter allow…

Methodology · Statistics 2021-03-05 Tijana Zrnic , Daniel L. Jiang , Aaditya Ramdas , Michael I. Jordan

An important limitation of standard multiple testing procedures is that the null distribution should be known. Here, we consider a null distribution-free approach for multiple testing in the following semi-supervised setting: the user does…

Statistics Theory · Mathematics 2022-12-08 David Mary , Etienne Roquain

While traditional multiple testing procedures prohibit adaptive analysis choices made by users, Goeman and Solari (2011) proposed a simultaneous inference framework that allows users such flexibility while preserving high-probability bounds…

Statistics Theory · Mathematics 2021-01-05 Eugene Katsevich , Aaditya Ramdas

We study the properties of false discovery rate (FDR) thresholding, viewed as a classification procedure. The "0"-class (null) is assumed to have a known density while the "1"-class (alternative) is obtained from the "0"-class either by…

Methodology · Statistics 2013-03-06 Pierre Neuvial , Etienne Roquain

Variable selection has been widely used in data analysis for the past decades, and it becomes increasingly important in the Big Data era as there are usually hundreds of variables available in a dataset. To enhance interpretability of a…

Methodology · Statistics 2020-08-17 Yuxiang Xie , Kwun Chuen Gary Chan

Large-scale hypothesis testing is central to modern science, where controlling the False Discovery Rate (FDR) has become the standard approach to managing false positives across many simultaneous tests. Hypotheses rarely exist in isolation;…

Methodology · Statistics 2026-05-19 Binyamin Perets , Shie Mannor

A cornerstone of the multiple testing literature is the Benjamini-Hochberg (BH) procedure, which guarantees control of the FDR when $p$-values are independent or positively dependent. While BH controls the average quality of rejections, it…

Methodology · Statistics 2026-03-31 Sarah Mostow , Daniel Xiang

In the context of multiple hypotheses testing, the proportion $\pi_0$ of true null hypotheses in the pool of hypotheses to test often plays a crucial role, although it is generally unknown a priori. A testing procedure using an implicit or…

Statistics Theory · Mathematics 2009-02-17 Gilles Blanchard , Etienne Roquain

The traditional approaches to false discovery rate (FDR) control in multiple hypothesis testing are usually based on the null distribution of a test statistic. However, all types of null distributions, including the theoretical,…

Methodology · Statistics 2021-04-13 Kun He , Mengjie Li , Yan Fu , Fuzhou Gong , Xiaoming Sun

Controlling false discovery rate (FDR) while leveraging the side information of multiple hypothesis testing is an emerging research topic in modern data science. Existing methods rely on the test-level covariates while ignoring possible…

Machine Learning · Statistics 2021-01-26 Lin Qiu , Nils Murrugarra-Llerena , Vítor Silva , Lin Lin , Vernon M. Chinchilli

This paper continues the line of research initiated in Liu et. al. (2016) on developing a novel framework for multiple testing of hypotheses grouped in a one-way classified form using hypothesis-specific local false discovery rates…

Methodology · Statistics 2022-11-22 Sanat K. Sarkar , Zhigen Zhao

The recent e-Benjamini-Hochberg (e-BH) procedure for multiple hypothesis testing is known to control the false discovery rate (FDR) under arbitrary dependence between the input e-values. This paper points out an important subtlety when…

Methodology · Statistics 2025-08-06 Hongjian Wang , Sanjit Dandapanthula , Aaditya Ramdas