English
Related papers

Related papers: Familywise Error Rate Control by Interactive Unmas…

200 papers

Hypothesis testing in the linear regression model is a fundamental statistical problem. We consider linear regression in the high-dimensional regime where the number of parameters exceeds the number of samples ($p> n$). In order to make…

Statistics Theory · Mathematics 2019-09-24 Adel Javanmard , Jason D. Lee

This paper provides two general classes of multiple decision functions where each member of the first class strongly controls the family-wise error rate (FWER), while each member of the second class strongly controls the false discovery…

Statistics Theory · Mathematics 2019-11-19 Edsel A. Pena , Joshua D. Habiger , Wensong Wu

In this paper, we have attempted to study the behaviour of the family wise error rate (FWER) for Bonferroni's procedure and false discovery rate (FDR) of the Benjamini-Hodgeberg procedure for simultaneous testing problem with equicorrelated…

Methodology · Statistics 2020-08-20 Nabaneet Das , Subir Kumar Bhandari

In this paper, the problem of error control of stepwise multiple testing procedures is considered. For two-sided hypotheses, control of both type 1 and type 3 (or directional) errors is required, and thus mixed directional familywise error…

Statistics Theory · Mathematics 2016-02-10 Wenge Guo , Joseph P. Romano

Experimental evaluations of public policies often randomize a new intervention within many sites or blocks. After a report of an overall result -- statistically significant or not -- the natural question from a policy maker is: \emph{where}…

Methodology · Statistics 2026-03-02 Jake Bowers , David Kim , Nuole Chen

Partial conjunction (PC) hypothesis testing is widely used to assess the replicability of scientific findings across multiple comparable studies. In high-throughput meta-analyses, testing a large number of PC hypotheses with k-family-wise…

Methodology · Statistics 2025-08-22 Ninh Tran

Multiple hypothesis testing problems arise naturally in science. In this paper, we introduce the new Fast Closed Testing (FACT) method for multiple testing, controlling the family-wise error rate. This error rate is state of the art in many…

Methodology · Statistics 2020-01-22 Edgar Dobriban

Multiple hypothesis testing, a situation when we wish to consider many hypotheses, is a core problem in statistical inference that arises in almost every scientific field. In this setting, controlling the false discovery rate (FDR), which…

Statistics Theory · Mathematics 2019-03-19 Shiyun Chen , Shiva Kasiviswanathan

In this paper,our main focus is to obtain an asymptotic bound on the family wise error rate (FWER) for Bonferroni-type procedure in the simultaneous hypotheses testing problem when the observations corresponding to individual hypothesis are…

Statistics Theory · Mathematics 2025-08-27 Nabaneet Das , Subir K. Bhandari

Many statistical problems can be addressed by applying a multiple testing procedure (MTP) that controls either the Family-wise Error Rate (FWER) or False Discovery Rate (FDR) under unknown arbitrarily-interdependent $p$-values, without…

Methodology · Statistics 2026-05-21 George Karabatsos

In multiple testing scenarios, typically the sign of a parameter is inferred when its estimate exceeds some significance threshold in absolute value. Typically, the significance threshold is chosen to control the experimentwise type I error…

Methodology · Statistics 2018-01-03 Chaoyu Yu , Peter D. Hoff

E-processes enable hypothesis testing with ongoing data collection while maintaining Type I error control. However, when testing multiple hypotheses simultaneously, current $e$-value based multiple testing methods such as e-BH are not…

Statistics Theory · Mathematics 2025-07-18 Yury Tavyrikov , Jelle J. Goeman , Rianne de Heide

When many (m) null hypotheses are tested with a single dataset, the control of the number of false rejections is often the principal consideration. Two popular controlling rates are the probability of making at least one false discovery…

Methodology · Statistics 2013-07-11 Djalel Eddine Meskaldji , Jean-Philippe Thiran , Stephan Morgenthaler

In this paper we introduce a novel procedure for improving multiple testing procedures (MTPs) under scenarios when the null hypothesis $p$-values tend to be stochastically larger than standard uniform (referred to as 'inflated'). An…

Methodology · Statistics 2025-08-29 Jules L. Ellis , Jakub Pecanka , Jelle Goeman

Modern data analysis frequently involves large-scale hypothesis testing, which naturally gives rise to the problem of maintaining control of a suitable type I error rate, such as the false discovery rate (FDR). In many biomedical and…

Methodology · Statistics 2023-07-25 David S. Robertson , James M. S. Wason , Aaditya Ramdas

MaxT is a highly popular resampling-based multiple testing procedure, which controls the Familywise Error Rate (FWER) and is powerful under dependence. This paper generalizes maxT to what we term ``multi-resolution'' False Discovery…

Methodology · Statistics 2026-05-05 Jesse Hemerik

In the context of multiple hypotheses testing, the proportion $\pi_0$ of true null hypotheses in the pool of hypotheses to test often plays a crucial role, although it is generally unknown a priori. A testing procedure using an implicit or…

Statistics Theory · Mathematics 2009-02-17 Gilles Blanchard , Etienne Roquain

Adjustment of statistical significance levels for repeated analysis in group sequential trials has been understood for some time. Similarly, methods for adjustment accounting for testing multiple hypotheses are common. There is limited…

Methodology · Statistics 2023-11-28 Yujie Zhao , Qi Liu , Linda Z. Sun , Keaven M. Anderson

The use of weights provides an effective strategy to incorporate prior domain knowledge in large-scale inference. This paper studies weighted multiple testing in a decision-theoretic framework. We develop oracle and data-driven procedures…

Methodology · Statistics 2017-05-10 Pallavi Basu , T. Tony Cai , Kiranmoy Das , Wenguang Sun

This article considers the problem of multiple hypothesis testing using $t$-tests. The observed data are assumed to be independently generated conditional on an underlying and unknown two-state hidden model. We propose an asymptotically…

Statistics Theory · Mathematics 2011-02-22 Hongyuan Cao , Michael R. Kosorok