English
Related papers

Related papers: Optimal multiple testing under family-wise error c…

200 papers

Improved procedures, in terms of smaller missed discovery rates (MDR), for performing multiple hypotheses testing with weak and strong control of the family-wise error rate (FWER) or the false discovery rate (FDR) are developed and studied.…

Statistics Theory · Mathematics 2011-03-10 Edsel A. Peña , Joshua D. Habiger , Wensong Wu

A topological multiple testing scheme for one-dimensional domains is proposed where, rather than testing every spatial or temporal location for the presence of a signal, tests are performed only at the local maxima of the smoothed observed…

Statistics Theory · Mathematics 2012-03-15 Armin Schwartzman , Yulia Gavrilov , Robert J. Adler

In any parametric inference problem, the robustness of the procedure is a real concern. A procedure which retains a high degree of efficiency under the model and simultaneously provides stable inference under data contamination is…

Methodology · Statistics 2020-01-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

Large-scale multiple testing is a fundamental problem in high dimensional statistical inference. It is increasingly common that various types of auxiliary information, reflecting the structural relationship among the hypotheses, are…

Methodology · Statistics 2021-10-07 Hongyuan Cao , Jun Chen , Xianyang Zhang

Structured multiple-testing problems (gatekeeping trials, dose-finding, multi-tissue eQTL mapping, bundled-challenger A/B experiments) organize hypotheses into design-imposed blocks and demand strong family-wise error rate (FWER) control…

Methodology · Statistics 2026-05-28 Prasanjit Dubey , Xiaoming Huo

The problem of multiple hypothesis testing arises when there are more than one hypothesis to be tested simultaneously for statistical significance. This is a very common situation in many data mining applications. For instance, assessing…

Machine Learning · Statistics 2009-06-30 Sami Hanhijärvi , Kai Puolamäki , Gemma C. Garriga

Analysis of low-degree polynomial algorithms is a powerful, newly-popular method for predicting computational thresholds in hypothesis testing problems. One limitation of current techniques for this analysis is their restriction to…

Statistics Theory · Mathematics 2020-11-10 Dmitriy Kunisky

Empirical research in the social and medical sciences frequently involves testing multiple hypotheses simultaneously, increasing the risk of false positives due to chance. Classical multiple testing procedures, such as the Bonferroni…

Econometrics · Economics 2025-07-29 Sebastian Calonico , Sebastian Galiani

We initiate a study of the following problem: Given a continuous domain $\Omega$ along with its convex hull $\mathcal{K}$, a point $A \in \mathcal{K}$ and a prior measure $\mu$ on $\Omega$, find the probability density over $\Omega$ whose…

Data Structures and Algorithms · Computer Science 2020-04-17 Jonathan Leake , Nisheeth K. Vishnoi

In confirmatory clinical trials with small sample sizes, hypothesis tests based on asymptotic distributions are often not valid and exact non-parametric procedures are applied instead. However, the latter are based on discrete test…

Methodology · Statistics 2018-02-22 Robin Ristl , Dong Xi , Ekkehard Glimm , Martin Posch

In this paper, we study the problem of testing the equality of two multivariate distributions. One class of tests used for this purpose utilizes geometric graphs constructed using inter-point distances. So far, the asymptotic theory of…

Statistics Theory · Mathematics 2025-04-22 Rahul Raphael Kanekar

When comparing two distributions, it is often helpful to learn at which quantiles or values there is a statistically significant difference. This provides more information than the binary "reject" or "do not reject" decision of a global…

Statistics Theory · Mathematics 2018-08-16 Matt Goldman , David M. Kaplan

We analyze control of the familywise error rate (FWER) in a multiple testing scenario with a great many null hypotheses about the distribution of a high-dimensional random variable among which only a very small fraction are false, or…

Methodology · Statistics 2015-09-15 Kamel Lahouel , Donald Geman , Laurent Younes

This paper studies the classical problem of estimating the locations of signal occurrences in a noisy measurement. Based on a multiple hypothesis testing scheme, we design a K-sample statistical test to control the false discovery rate…

Signal Processing · Electrical Eng. & Systems 2022-09-26 Uriel Shiterburd , Tamir Bendory , Amichai Painsky

Bonferroni's correction is a popular tool to address multiplicity but is notorious for its low power when tests are dependent. This paper proposes a practical modification of Bonferroni's correction when test statistics are jointly normal…

Methodology · Statistics 2026-02-24 Caleb Hiltunen , Yeonwoo Rho

We present a novel method for controlling the $k$-familywise error rate ($k$-FWER) in the linear regression setting using the knockoffs framework first introduced by Barber and Cand\`es. Our procedure, which we also refer to as knockoffs,…

Methodology · Statistics 2015-11-10 Lucas Janson , Weijie Su

Range coders and ANS replace empirical probabilities with integer frequencies summing to a fixed $M$; the resulting per-symbol code-length redundancy is exactly the KL divergence of the empirical distribution from the quantized one.…

Information Theory · Computer Science 2026-05-04 Kamila Szewczyk

A family of maximum mean discrepancy (MMD) kernel two-sample tests is introduced. Members of the test family are called Block-tests or B-tests, since the test statistic is an average over MMDs computed on subsets of the samples. The choice…

Machine Learning · Computer Science 2014-02-11 Wojciech Zaremba , Arthur Gretton , Matthew Blaschko

Traditional hypothesis tests for differences between binomial proportions are at risk of being too liberal (Wald test) or overly conservative (Fisher's exact test). This problem is exacerbated in small samples. Regulators favour exact…

Methodology · Statistics 2025-07-31 Stef Baas , Yaron Racah , Elad Berkman , Sofia S. Villar

Multiple hypothesis testing problems arise naturally in science. In this paper, we introduce the new Fast Closed Testing (FACT) method for multiple testing, controlling the family-wise error rate. This error rate is state of the art in many…

Methodology · Statistics 2020-01-22 Edgar Dobriban