English
Related papers

Related papers: On Asymptotic Behaviors of Stepwise Multiple Testi…

200 papers

When dealing with the problem of simultaneously testing a large number of null hypotheses, a natural testing strategy is to first reduce the number of tested hypotheses by some selection (screening or filtering) process, and then to…

Methodology · Statistics 2017-03-21 Wenge Guo , Joseph P. Romano

Conventional multiple hypothesis tests use step-up, step-down, or closed testing methods to control the overall error rates. We will discuss marrying these methods with adaptive multistage sampling rules and stopping rules to perform…

Methodology · Statistics 2011-07-12 Jay Bartroff , Tze Leung Lai

When simultaneously testing multiple hypotheses, the usual approach in the context of confirmatory clinical trials is to control the familywise error rate (FWER), which bounds the probability of making at least one false rejection. In many…

Methodology · Statistics 2021-05-20 David S. Robertson , James M. S. Wason , Frank Bretz

Closed testing procedures are classically used for familywise error rate (FWER) control, but they can also be used to obtain simultaneous confidence bounds for the false discovery proportion (FDP) in all subsets of the hypotheses. In this…

Methodology · Statistics 2019-11-15 Jelle Goeman , Rosa Meijer , Thijmen Krebs , Aldo Solari

Experimental evaluations of public policies often randomize a new intervention within many sites or blocks. After a report of an overall result -- statistically significant or not -- the natural question from a policy maker is: \emph{where}…

Methodology · Statistics 2026-03-02 Jake Bowers , David Kim , Nuole Chen

Rare and Weak models for multiple hypothesis testing assume that only a small proportion of the tested hypotheses concern non-null effects and the individual effects are only moderately large, so they generally do not stand out…

Statistics Theory · Mathematics 2025-02-20 Alon Kipnis

Closed testing and partitioning are recognized as fundamental principles of familywise error control. In this paper, we argue that sequential rejection can be considered equally fundamental as a general principle of multiple testing. We…

Statistics Theory · Mathematics 2012-11-15 Jelle J. Goeman , Aldo Solari

We consider multiple testing with false discovery rate (FDR) control when p-values have discrete and heterogeneous null distributions. We propose a new estimator of the proportion of true null hypotheses and demonstrate that it is less…

Methodology · Statistics 2018-03-15 Xiongzhi Chen , Rebecca W. Doerge , Joseph F. Heyse

A topological multiple testing scheme for one-dimensional domains is proposed where, rather than testing every spatial or temporal location for the presence of a signal, tests are performed only at the local maxima of the smoothed observed…

Statistics Theory · Mathematics 2012-03-15 Armin Schwartzman , Yulia Gavrilov , Robert J. Adler

This paper revisits the following open question in simultaneous testing of multivariate normal means against two-sided alternatives: Can the method of Benjamini and Hochberg (BH, 1995) control the false discovery rate (FDR) without imposing…

Statistics Theory · Mathematics 2023-04-12 Sanat K. Sarkar

A cornerstone of the multiple testing literature is the Benjamini-Hochberg (BH) procedure, which guarantees control of the FDR when $p$-values are independent or positively dependent. While BH controls the average quality of rejections, it…

Methodology · Statistics 2026-03-31 Sarah Mostow , Daniel Xiang

In this paper, we consider the problem of simultaneous testing of multivariate normal means under arbitrary covariance dependence. Specifically, let $\boldsymbol{X}\sim N_n(\boldsymbol{\theta},\boldsymbol{\Sigma})$, where…

Statistics Theory · Mathematics 2026-05-29 Prasenjit Ghosh , Arijit Chakrabarti

In this paper, we consider the problem of simultaneously testing many two-sided hypotheses when rejections of null hypotheses are accompanied by claims of the direction of the alternative. The fundamental goal is to construct methods that…

Statistics Theory · Mathematics 2017-03-21 Anjana Grandhi , Wenge Guo , Joseph P. Romano

We present a procedure for controlling FWER when sequentially considering successive subfamilies of null hypotheses and rejecting at most one from each subfamily. Our procedure differs from previous procedures for controlling FWER by…

Methodology · Statistics 2017-02-15 Geoffrey I. Webb , Mark van der Laan

We study asymptotic properties of Bayesian multiple testing procedures and provide sufficient conditions for strong consistency under general dependence structure. We also consider a novel Bayesian multiple testing procedure and associated…

Statistics Theory · Mathematics 2020-05-15 Noirrit K. Chandra , Sourabh Bhattacharya

We introduce a new class of methods for finite-sample false discovery rate (FDR) control in multiple testing problems with dependent test statistics where the dependence is fully or partially known. Our approach separately calibrates a…

Methodology · Statistics 2020-07-22 William Fithian , Lihua Lei

The standard paradigm for confirmatory clinical trials is to compare experimental treatments with a control, for example the standard of care or a placebo. However, it is not always the case that a suitable control exists. Efficient…

Methodology · Statistics 2024-10-29 Thomas Burnett , Thomas Jaki

The Benjamini-Hochberg (BH) procedure remains widely popular despite having limited theoretical guarantees in the commonly encountered scenario of correlated test statistics. Of particular concern is the possibility that the method could…

Statistics Theory · Mathematics 2023-11-14 Dan M. Kluger , Art B. Owen

In genetic association studies, detecting phenotype-genotype association is a primary goal. We assume that the relationship between the data -phenotype, genetic markers and environmental covariates - can be modelled by a generalized linear…

Methodology · Statistics 2020-04-13 K. K. Halle , Ø. Bakke , S. Djurovic , A. Bye , E. Ryeng , U. Wisløff , O. A. Andreassen , M. Langaas

In this article, we propose a generalized weighted version of the well-known Benjamini-Hochberg (BH) procedure. The rigorous weighting scheme used by our method enables it to encode structural information from simultaneous multi-way…

Methodology · Statistics 2021-05-25 Shinjini Nandi , Sanat K. Sarkar