English
Related papers

Related papers: Bringing Closure to False Discovery Rate Control: …

200 papers

The traditional approaches to false discovery rate (FDR) control in multiple hypothesis testing are usually based on the null distribution of a test statistic. However, all types of null distributions, including the theoretical,…

Methodology · Statistics 2021-04-13 Kun He , Mengjie Li , Yan Fu , Fuzhou Gong , Xiaoming Sun

Much effort has been done to control the "false discovery rate" (FDR) when $m$ hypotheses are tested simultaneously. The FDR is the expectation of the "false discovery proportion" $\text{FDP}=V/R$ given by the ratio of the number of false…

Statistics Theory · Mathematics 2018-01-09 Marc Ditzhaus , Arnold Janssen

In modern scientific experiments, we frequently encounter data that have large dimensions, and in some experiments, such high dimensional data arrive sequentially rather than full data being available all at a time. We develop multiple…

Methodology · Statistics 2023-06-09 Rahul Roy , Shyamal K. De , Subir Kumar Bhandari

We show that the control of the false discovery rate (FDR) for a multiple testing procedure is implied by two coupled simple sufficient conditions. The first one, which we call ``self-consistency condition'', concerns the algorithm itself,…

Statistics Theory · Mathematics 2008-10-21 Gilles Blanchard , Etienne Roquain

This paper presents a survey on some recent advances for the type I error rate control in multiple testing methodology. We consider the problem of controlling the $k$-family-wise error rate (kFWER, probability to make $k$ false discoveries…

Methodology · Statistics 2011-03-15 Etienne Roquain

Complex large-scale studies, such as those related to microarray data and fMRI studies, often involve testing multiple hierarchically ordered hypotheses. However, most existing false discovery rate (FDR) controlling procedures do not…

Methodology · Statistics 2016-12-15 Gavin Lynch , Wenge Guo

Closed testing and partitioning are recognized as fundamental principles of familywise error control. In this paper, we argue that sequential rejection can be considered equally fundamental as a general principle of multiple testing. We…

Statistics Theory · Mathematics 2012-11-15 Jelle J. Goeman , Aldo Solari

We address the multiple testing problem under the assumption that the true/false hypotheses are driven by a Hidden Markov Model (HMM), which is recognized as a fundamental setting to model multiple testing under dependence since the seminal…

Methodology · Statistics 2021-05-04 Marie Perrot-Dockès , Gilles Blanchard , Pierre Neuvial , Etienne Roquain

One important partition of algorithms for controlling the false discovery rate (FDR) in multiple testing is into offline and online algorithms. The first generally achieve significantly higher power of discovery, while the latter allow…

Methodology · Statistics 2021-03-05 Tijana Zrnic , Daniel L. Jiang , Aaditya Ramdas , Michael I. Jordan

Invariant causal prediction provides a useful framework for identifying causal predictors of a response using heterogeneous data from multiple environments. One valuable property of the original invariant causal prediction method is that it…

Methodology · Statistics 2026-05-21 Jinzhou Li , Jelle J Goeman

A classical approach for dealing with the multiple testing problem is to restrict attention to procedures that control the familywise error rate (FWER), the probability of at least one false rejection. In many applications, one might be…

Statistics Theory · Mathematics 2008-10-29 Wenge Guo , M. Bhaskara Rao

The large bulk of work in multiple testing has focused on specifying procedures that control the false discovery rate (FDR), with relatively less attention being paid to the corresponding Type II error known as the false non-discovery rate…

Statistics Theory · Mathematics 2020-05-11 Max Rabinovich , Michael I. Jordan , Martin J. Wainwright

When testing many hypotheses, often we do not have strong expectations about the directions of the effects. In some situations however, the alternative hypotheses are that the parameters lie in a certain direction or interval, and it is in…

Methodology · Statistics 2026-03-02 Jesse Hemerik

In the setting of multiple testing, compound p-values generalize p-values by asking for superuniformity to hold only \emph{on average} across all true nulls. We study the properties of the Benjamini--Hochberg procedure applied to compound…

Statistics Theory · Mathematics 2025-07-30 Rina Foygel Barber , Richard J Samworth

Modern applications of conformal inference to multiple testing problems, such as outlier detection and candidate selection, often involve selecting test samples whose conformal p-values fall below a threshold. The quality of such methods is…

Methodology · Statistics 2026-05-21 Ziang Song , Ying Jin , Emmanuel J. Candès

Multiple hypothesis testing is a central topic in statistics, but despite abundant work on the false discovery rate (FDR) and the corresponding Type-II error concept known as the false non-discovery rate (FNR), a fine-grained understanding…

Statistics Theory · Mathematics 2017-05-17 Maxim Rabinovich , Aaditya Ramdas , Michael I. Jordan , Martin J. Wainwright

The Benjamini-Yekutieli procedure is a multiple testing method that controls the false discovery rate under arbitrary dependence of the $p$-values. A modification of this and related procedures is proposed for the case when the test…

Statistics Theory · Mathematics 2016-12-16 Sebastian Döhler

Much effort has been made to improve the famous step up test of Benjamini and Hochberg given by linear critical values $\frac{i\alpha}{n}$. It is pointed out by Gavrilov, Benjamini and Sarkar that step down multiple tests based on the…

Statistics Theory · Mathematics 2016-08-10 Julia Benditkis , Arnold Janssen

Multiple testing problems are a staple of modern statistical analysis. The fundamental objective of multiple testing procedures is to reject as many false null hypotheses as possible (that is, maximize some notion of power), subject to…

Methodology · Statistics 2020-11-30 Saharon Rosset , Ruth Heller , Amichai Painsky , Ehud Aharoni

Benjamini and Hochberg (1995) proposed the false discovery rate (FDR) as an alternative to the family-wise error rate in multiple testing problems, and proposed a procedure to control the FDR. For discrete data this procedure may be highly…

Methodology · Statistics 2014-01-28 Ruth Heller , Hadas Gur