English
Related papers

Related papers: On Asymptotic Behaviors of Stepwise Multiple Testi…

200 papers

Consider the problem of testing $s$ hypotheses simultaneously. The usual approach restricts attention to procedures that control the probability of even one false rejection, the familywise error rate (FWER). If $s$ is large, one might be…

Statistics Theory · Mathematics 2007-11-06 Joseph P. Romano , Michael Wolf

In many applications, hypothesis testing is based on an asymptotic distribution of statistics. The aim of this paper is to clarify and extend multiple correction procedures when the statistics are asymptotically Gaussian. We propose a…

Statistics Theory · Mathematics 2020-07-03 Sophie Achard , Pierre Borgnat , Irène Gannaz

We present a unifying approach to multiple testing procedures for sequential (or streaming) data by giving sufficient conditions for a sequential multiple testing procedure to control the familywise error rate (FWER), extending to the…

Methodology · Statistics 2015-02-25 Jay Bartroff , Jinlin Song

Consider the problem of testing multiple null hypotheses. A classical approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate ($FWER$), the probability of even one…

Statistics Theory · Mathematics 2007-06-13 Joseph P. Romano , Azeem M. Shaikh

Multiple hypothesis testing is a significant problem in nearly all neuroimaging studies. In order to correct for this phenomena, we require a reliable estimate of the Family-Wise Error Rate (FWER). The well known Bonferroni correction…

Computation · Statistics 2015-02-17 Chris Hinrichs , Vamsi K Ithapu , Qinyuan Sun , Sterling C Johnson , Vikas Singh

Improved procedures, in terms of smaller missed discovery rates (MDR), for performing multiple hypotheses testing with weak and strong control of the family-wise error rate (FWER) or the false discovery rate (FDR) are developed and studied.…

Statistics Theory · Mathematics 2011-03-10 Edsel A. Peña , Joshua D. Habiger , Wensong Wu

The closure principle is a standard tool for achieving strong family-wise error rate (FWER) control in multiple testing problems. We develop an e-value-based closed testing framework that inherits nice properties of e-values, which are…

Methodology · Statistics 2026-05-19 Will Hartog , Lihua Lei

We propose a method for multiple hypothesis testing with familywise error rate (FWER) control, called the i-FWER test. Most testing methods are predefined algorithms that do not allow modifications after observing the data. However, in…

Methodology · Statistics 2021-04-20 Boyan Duan , Aaditya Ramdas , Larry Wasserman

In online multiple testing, an a priori unknown number of hypotheses are tested sequentially, i.e. at each time point a test decision for the current hypothesis has to be made using only the data available so far. Although many powerful…

Methodology · Statistics 2025-03-11 Vincent Jankovic , Lasse Fischer , Werner Brannath

Consider the multiple testing problem of testing null hypotheses $H_1,...,H_s$. A classical approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate ($\mathit{FWER}$),…

Statistics Theory · Mathematics 2007-06-13 Joseph P. Romano , Azeem M. Shaikh

The most popular multiple testing procedures are stepwise procedures based on $P$-values for individual test statistics. Included among these are the false discovery rate (FDR) controlling procedures of Benjamini--Hochberg [J. Roy. Statist.…

Statistics Theory · Mathematics 2009-06-18 Arthur Cohen , Harold B. Sackrowitz , Minya Xu

In many applications of multiple hypothesis testing where more than one false rejection can be tolerated, procedures controlling error rates measuring at least $k$ false rejections, instead of at least one, for some fixed $k\ge 1$ can…

Statistics Theory · Mathematics 2008-12-18 Sanat K. Sarkar

In complex clinical trials, multiple research objectives are often grouped into sets of objectives based on their inherent hierarchical relationships. Consequently, the hypotheses formulated to address these objectives are grouped into…

Methodology · Statistics 2016-11-11 Zhiying Qiu , Wenge Guo , Sanat Sarkar

Adjustment of statistical significance levels for repeated analysis in group sequential trials has been understood for some time. Similarly, methods for adjustment accounting for testing multiple hypotheses are common. There is limited…

Methodology · Statistics 2023-11-28 Yujie Zhao , Qi Liu , Linda Z. Sun , Keaven M. Anderson

We investigate asymptotically optimal multiple testing procedures for streams of sequential data in the context of prior information on the number of false null hypotheses ("signals"). We show that the "gap" and "gap-intersection"…

Methodology · Statistics 2020-05-04 Xinrui He , Jay Bartroff

To find interesting items in genome-wide association studies or next generation sequencing data, a crucial point is to design powerful false discovery rate (FDR) controlling procedures that suitably combine discrete tests (typically…

Statistics Theory · Mathematics 2017-09-18 Sebastian Döhler , Guillermo Durand , Etienne Roquain

How to weigh the Benjamini-Hochberg procedure? In the context of multiple hypothesis testing, we propose a new step-wise procedure that controls the false discovery rate (FDR) and we prove it to be more powerful than any weighted…

Statistics Theory · Mathematics 2009-07-13 Etienne Roquain , Mark Van De Wiel

The $\gamma$-FDP and $k$-FWER multiple testing error metrics, which are tail probabilities of the respective error statistics, have become popular recently as less-stringent alternatives to the FDR and FWER. We propose general and flexible…

Methodology · Statistics 2016-12-20 Jay Bartroff

Simultaneous statistical inference has been a cornerstone in the statistics methodology literature because of its fundamental theory and paramount applications. The mainstream multiple testing literature has traditionally considered two…

Statistics Theory · Mathematics 2025-03-21 Monitirtha Dey , Subir Kumar Bhandari

Multiple tests are designed to test a whole collection of null hypotheses simultaneously. Their quality is often judged by the false discovery rate (FDR), i.e. the expectation of the quotient of the number of false rejections divided by the…

Statistics Theory · Mathematics 2015-11-24 Julia Benditkis , Philipp Heesen , Arnold Janssen