English
Related papers

Related papers: Permutation p-values should never be zero: calcula…

200 papers

Exact null distributions of goodness-of-fit test statistics are generally challenging to obtain in tractable forms. Practitioners are therefore usually obliged to rely on asymptotic null distributions or Monte Carlo methods, either in the…

Methodology · Statistics 2023-09-06 Alberto Fernández-de-Marcos , Eduardo García-Portugués

The gold standard for identifying causal relationships is a randomized controlled experiment. In many applications in the social sciences and medicine, the researcher does not control the assignment mechanism and instead may rely upon…

Applications · Statistics 2016-11-22 Johann Gagnon-Bartsch , Yotam Shem-Tov

In many settings, robust data analysis involves computational methods for uncertainty quantification and statistical inference. To design frequentist studies that leverage robust analysis methods, suitable sample sizes to achieve desired…

Methodology · Statistics 2025-12-19 Luke Hagar , Andrew J. Martin

It is quite common in modern research, for a researcher to test many hypotheses. The statistical (frequentist) hypothesis testing framework, does not scale with the number of hypotheses in the sense that naively performing many hypothesis…

Methodology · Statistics 2013-06-26 Jonathan Rosenblatt

We study properties of two resampling scenarios: Conditional Randomisation and Conditional Permutation schemes, which are relevant for testing conditional independence of discrete random variables $X$ and $Y$ given a random variable $Z$.…

Statistics Theory · Mathematics 2023-04-14 Małgorzata Łazęcka , Bartosz Kołodziejek , Jan Mielniczuk

Testing whether the observed data conforms to a purported model (probability distribution) is a basic and fundamental statistical task, and one that is by now well understood. However, the standard formulation, identity testing, fails to…

Statistics Theory · Mathematics 2021-05-06 Clément L. Canonne , Karl Wimmer

A common problem in machine learning is determining if a variable significantly contributes to a model's prediction performance. This problem is aggravated for datasets, such as gene expression datasets, that suffer the worst case of…

Methodology · Statistics 2023-10-13 Yue Wu , Ted Spaide , Kenji Nakamichi , Russell Van Gelder , Aaron Lee

This article presents an algorithm that generates a conservative confidence interval of a specified length and coverage probability for the power of a Monte Carlo test (such as a bootstrap or permutation test). It is the first method that…

Computation · Statistics 2013-03-13 Axel Gandy , Patrick Rubin-Delanchy

We propose a novel resampling-based method to construct an asymptotically exact test for any subset of hypotheses on coefficients in high-dimensional linear regression. It can be embedded into any multiple testing procedure to make…

Methodology · Statistics 2022-05-26 Anna Vesely , Jelle J. Goeman , Livio Finos

Significance testing based on p-values has been implicated in the reproducibility crisis in scientific research, with one of the proposals being to eliminate them in favor of Bayesian analyses. Defenders of the p-values have countered that…

Methodology · Statistics 2023-05-02 Christos Argyropoulos , Andy P Grieve

Much of science is (rightly or wrongly) driven by hypothesis testing. Even in situations where the hypothesis testing paradigm is correct, the common practice of basing inferences solely on p-values has been under intense criticism for over…

Methodology · Statistics 2015-12-31 M. J. Bayarri , Daniel J. Benjamin , James O. Berger , Thomas M. Sellke

P-values are widely used in both the social and natural sciences to quantify the statistical significance of observed results. The recent surge of big data research has made the p-value an even more popular tool to test the significance of…

Applications · Statistics 2023-01-05 Bertie Vidgen , Taha Yasseri

While P-values are widely abused, they are a useful tool for many purposes; banning them is analogous to banning scalpels because most people do not know how to perform surgery. Many reported P-values are not genuine P-values, for a variety…

Other Statistics · Statistics 2022-04-19 Philip B. Stark

Permutation tests are a popular choice for distinguishing distributions and testing independence, due to their exact, finite-sample control of false positives and their minimax optimality when paired with U-statistics. However, standard…

Statistics Theory · Mathematics 2025-03-26 Carles Domingo-Enrich , Raaz Dwivedi , Lester Mackey

When the target parameter for inference is a real-valued, continuous function of probabilities in the $k$-sample multinomial problem, variance estimation may be challenging. In small samples or when the function is nondifferentiable at the…

Computation · Statistics 2025-05-13 Michael C Sachs , Erin E Gabriel , Michael P Fay

In this article we study in detail a family of random matrix ensembles which are obtained from random permutations matrices (chosen at random according to the Ewens measure of parameter $\theta>0$) by replacing the entries equal to one by…

Probability · Mathematics 2010-05-05 Joseph Najnudel , Ashkan Nikeghbali

Assigning significance in high-dimensional regression is challenging. Most computationally efficient selection algorithms cannot guard against inclusion of noise variables. Asymptotically valid p-values are not available. An exception is a…

Methodology · Statistics 2009-06-12 Nicolai Meinshausen , Lukas Meier , Peter Bühlmann

When modeling the distribution of a multivariate continuous random vector using the so-called \emph{copula approach}, it is not uncommon to have ties in the coordinate samples of the available data because of rounding or lack of measurement…

Methodology · Statistics 2017-02-07 Ivan Kojadinovic

Likelihood ratio tests are a widely used method in global analyses in particle physics. The computation of the statistical significance (p-value) of these tests is usually done with a simple formula that relies on Wilks' theorem. There are,…

High Energy Physics - Phenomenology · Physics 2013-08-21 Martin Wiebusch

Extant "fast" algorithms for Monte Carlo confidence sets are limited to univariate shift parameters for the one-sample and two-sample problems using the sample mean as the test statistic; moreover, some do not converge reliably and most do…

Computation · Statistics 2025-02-27 Amanda K. Glazer , Philip B. Stark