English
Related papers

Related papers: Multiple Testing of Linear Forms for Noisy Matrix …

200 papers

The False Discovery Rate (FDR) is a new statistical procedure to control the number of mistakes made when performing multiple hypothesis tests, i.e. when comparing many data against a given model hypothesis. The key advantage of FDR is that…

We present false discovery rate smoothing, an empirical-Bayes method for exploiting spatial structure in large multiple-testing problems. FDR smoothing automatically finds spatially localized regions of significant test statistics. It then…

Methodology · Statistics 2016-11-15 Wesley Tansey , Oluwasanmi Koyejo , Russell A. Poldrack , James G. Scott

We develop a flexible feature selection framework based on deep neural networks that approximately controls the false discovery rate (FDR), a measure of Type-I error. The method applies to architectures whose first layer is fully connected.…

Machine Learning · Statistics 2026-02-10 Kazuma Sawaya

False discovery rate (FDR) procedures provide misleading inference when testing multiple null hypotheses with heterogeneous multinomial data. For example, in the motivating study the goal is to identify species of bacteria near the roots of…

Methodology · Statistics 2015-11-05 Joshua Habiger , David Watts , Michael Anderson

In large scale multiple testing problems, a two-class empirical Bayes approach can be used to control the false discovery rate (Fdr) for the entire array of hypotheses under study. A sample splitting step is incorporated to modify that…

Computation · Statistics 2019-12-13 Paramita Chakraborty , Chong Ma , John Grego , James Lynch

We propose a general and flexible procedure for testing multiple hypotheses about sequential (or streaming) data that simultaneously controls both the false discovery rate (FDR) and false nondiscovery rate (FNR) under minimal assumptions…

Methodology · Statistics 2019-01-14 Jay Bartroff , Jinlin Song

We propose the use of a new false discovery rate (FDR) controlling procedure as a model selection penalized method, and compare its performance to that of other penalized methods over a wide range of realistic settings: nonorthogonal design…

Applications · Statistics 2009-05-19 Yoav Benjamini , Yulia Gavrilov

Multiple hypothesis testing often involves composite nulls, i.e., nulls that are associated with two or more distributions. In many cases, it is reasonable to assume that there is a prior distribution on the distributions despite it is…

Statistics Theory · Mathematics 2008-07-31 Zhiyi Chi

In high dimensional variable selection problems, statisticians often seek to design multiple testing procedures that control the False Discovery Rate (FDR), while concurrently identifying a greater number of relevant variables. Model-X…

Statistics Theory · Mathematics 2023-07-25 Taejoo Ahn , Licong Lin , Song Mei

The positive false discovery rate (pFDR) is a useful overall measure of errors for multiple hypothesis testing, especially when the underlying goal is to attain one or more discoveries. Control of pFDR critically depends on how much…

Statistics Theory · Mathematics 2011-11-09 Zhiyi Chi

The generalized linear models (GLM) have been widely used in practice to model non-Gaussian response variables. When the number of explanatory features is relatively large, scientific researchers are of interest to perform controlled…

Methodology · Statistics 2020-07-03 Chenguang Dai , Buyu Lin , Xin Xing , Jun S. Liu

This paper explores the multiple testing problem for sparse high-dimensional data with binary outcomes. We propose novel empirical Bayes multiple testing procedures based on a spike-and-slab posterior and then evaluate their performance in…

Statistics Theory · Mathematics 2025-06-16 Yu-Chien Bo Ning

In this paper we introduce and investigate a new rejection curve for asymptotic control of the false discovery rate (FDR) in multiple hypotheses testing problems. We first give a heuristic motivation for this new curve and propose some…

Statistics Theory · Mathematics 2009-03-31 Helmut Finner , Thorsten Dickhaus , Markus Roters

Testing for differences in features between clusters in various applications often leads to inflated false positives when practitioners use the same dataset to identify clusters and then test features, an issue commonly known as ``double…

Methodology · Statistics 2024-10-10 Lijun Wang , Yingxin Lin , Hongyu Zhao

We propose sequential multiple testing procedures which control the false discover rate (FDR) or the positive false discovery rate (pFDR) under arbitrary dependence between the data streams. This is accomplished by "optimizing" an upper…

Methodology · Statistics 2024-11-27 Michael Hankin , Jay Bartroff

The false discovery rate (FDR)---the expected fraction of spurious discoveries among all the discoveries---provides a popular statistical assessment of the reproducibility of scientific studies in various disciplines. In this work, we…

Machine Learning · Statistics 2015-11-10 Weijie Su , Junyang Qian , Linxi Liu

In hypothesis testing, a false discovery occurs when a hypothesis is incorrectly rejected due to noise in the sample. When adaptively testing multiple hypotheses, the probability of a false discovery increases as more tests are performed.…

Machine Learning · Statistics 2020-10-22 Wanrong Zhang , Gautam Kamath , Rachel Cummings

Out of the participants in a randomized experiment with anticipated heterogeneous treatment effects, is it possible to identify which subjects have a positive treatment effect? While subgroup analysis has received attention, claims about…

Methodology · Statistics 2024-05-14 Boyan Duan , Larry Wasserman , Aaditya Ramdas

False discovery rate (FDR) is commonly used for correction for multiple testing in neuroimaging studies. However, when using two-tailed tests, making directional inferences about the results can lead to a vastly inflated error rate, even…

Methodology · Statistics 2025-12-16 Anderson M. Winkler , Paul A. Taylor , Thomas E. Nichols , Chris Rorden

Simultaneously performing variable selection and inference in high-dimensional models is an open challenge in statistics and machine learning. The increasing availability of vast amounts of variables requires the adoption of specific…

Methodology · Statistics 2025-10-02 Marco Molinari , Magne Thoresen