English
Related papers

Related papers: False Discovery Control in Multiple Testing: A Bri…

200 papers

This paper explores a connection between empirical Bayes posterior distributions and false discovery rate (FDR) control. In the Gaussian sequence model, this work shows that empirical Bayes-calibrated spike and slab posterior distributions…

Statistics Theory · Mathematics 2019-06-18 Ismael Castillo , Etienne Roquain

Multiple testing problems are a staple of modern statistical analysis. The fundamental objective of multiple testing procedures is to reject as many false null hypotheses as possible (that is, maximize some notion of power), subject to…

Methodology · Statistics 2020-11-30 Saharon Rosset , Ruth Heller , Amichai Painsky , Ehud Aharoni

We introduce a new class of methods for finite-sample false discovery rate (FDR) control in multiple testing problems with dependent test statistics where the dependence is fully or partially known. Our approach separately calibrates a…

Methodology · Statistics 2020-07-22 William Fithian , Lihua Lei

Analyzing large-scale, multi-experiment studies requires scientists to test each experimental outcome for statistical significance and then assess the results as a whole. We present Black Box FDR (BB-FDR), an empirical-Bayes method for…

Machine Learning · Statistics 2018-06-11 Wesley Tansey , Yixin Wang , David M. Blei , Raul Rabadan

The present paper introduces new adaptive multiple tests which rely on the estimation of the number of true null hypotheses and which control the false discovery rate (FDR) at level alpha for finite sample size. We derive exact formulas for…

Statistics Theory · Mathematics 2014-10-24 Philipp Heesen , Arnold Janssen

The false discovery proportion (FDP) is a convenient way to account for false positives when a large number $m$ of tests are performed simultaneously. Romano and Wolf [Ann. Statist. 35 (2007) 1378-1408] have proposed a general principle…

Statistics Theory · Mathematics 2015-06-08 Sylvain Delattre , Etienne Roquain

Multiple hypothesis testing is a central topic in statistics, but despite abundant work on the false discovery rate (FDR) and the corresponding Type-II error concept known as the false non-discovery rate (FNR), a fine-grained understanding…

Statistics Theory · Mathematics 2017-05-17 Maxim Rabinovich , Aaditya Ramdas , Michael I. Jordan , Martin J. Wainwright

Multiple testing literature contains ample research on controlling false discoveries for hypotheses classified according to one criterion, which we refer to as one-way classified hypotheses. Although simultaneous classification of…

Methodology · Statistics 2019-03-12 Shinjini Nandi , Sanat K. Sarkar

In the setting of multiple testing, compound p-values generalize p-values by asking for superuniformity to hold only \emph{on average} across all true nulls. We study the properties of the Benjamini--Hochberg procedure applied to compound…

Statistics Theory · Mathematics 2025-07-30 Rina Foygel Barber , Richard J Samworth

One important partition of algorithms for controlling the false discovery rate (FDR) in multiple testing is into offline and online algorithms. The first generally achieve significantly higher power of discovery, while the latter allow…

Methodology · Statistics 2021-03-05 Tijana Zrnic , Daniel L. Jiang , Aaditya Ramdas , Michael I. Jordan

Motivation: In microarray analysis, special consideration must be given to the issues of multiple statistical tests and typically p-values are adjusted to control family-wise error rate (FWER) or false discovery rate (FDR). FDR metrics have…

Quantitative Methods · Quantitative Biology 2007-05-23 Rishi L. Khan , Rajanikanth Vadigepalli , Guang Gao , James S. Schwaber

High-dimensional sparse generalized linear models (GLMs) have emerged in the setting that the number of samples and the dimension of variables are large, and even the dimension of variables grows faster than the number of samples. False…

Statistics Theory · Mathematics 2021-05-04 Chang Cui , Jinzhu Jia , Yijun Xiao , Huiming Zhang

Motivation: Target-decoy search (TDS) is currently the most popular strategy for estimating and controlling the false discovery rate (FDR) of peptide identifications in mass spectrometry-based shotgun proteomics. While this strategy is very…

Applications · Statistics 2015-01-06 Kun He , Yan Fu , Wen-Feng Zeng , Lan Luo , Hao Chi , Chao Liu , Lai-Yun Qing , Rui-Xiang Sun , Si-Min He

Controlling the False Discovery Rate (FDR) in a variable selection procedure is critical for reproducible discoveries, and it has been extensively studied in sparse linear models. However, it remains largely open in scenarios where the…

Methodology · Statistics 2023-11-16 Yang Cao , Xinwei Sun , Yuan Yao

In this paper, we present novel methodologies that incorporate auxiliary variables for multiple hypotheses testing related to the main point of interest while effectively controlling the false discovery rate. When dealing with multiple…

Methodology · Statistics 2026-02-23 Seohwa Hwang , Mark Louie Ramos , DoHwan Park , Junyong Park , Johan Lim , Erin Green

The False Discovery Rate (FDR) is a commonly used type I error rate in multiple testing problems. It is defined as the expected False Discovery Proportion (FDP), that is, the expected fraction of false positives among rejected hypotheses.…

Statistics Theory · Mathematics 2013-10-04 Pierre Neuvial

Differentially private multiple testing procedures can protect the information of individuals used in hypothesis tests while guaranteeing a small fraction of false discoveries. In this paper, we propose a differentially private adaptive FDR…

Machine Learning · Statistics 2023-06-01 Xintao Xia , Zhanrui Cai

Consider the problem of simultaneously testing null hypotheses H_1,...,H_s. The usual approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate (FWER), the probability of…

Statistics Theory · Mathematics 2007-06-13 E. L. Lehmann , Joseph P. Romano

The effective utilization of structural information in data while ensuring statistical validity poses a significant challenge in false discovery rate (FDR) analyses. Conformal inference provides rigorous theory for grounding complex machine…

Methodology · Statistics 2024-06-18 Zinan Zhao , Wenguang Sun

Some effort has been undertaken over the last decade to provide conditions for the control of the false discovery rate by the linear step-up procedure (LSU) for testing $n$ hypotheses when test statistics are dependent. In this paper we…

Statistics Theory · Mathematics 2007-10-18 Helmut Finner , Thorsten Dickhaus , Markus Roters