English
Related papers

Related papers: Permutation p-values should never be zero: calcula…

200 papers

Non-parametric two-sample tests based on energy distance or maximum mean discrepancy are widely used statistical tests for comparing multivariate data from two populations. While these tests enjoy desirable statistical properties, their…

Computation · Statistics 2024-06-11 Elias Chaibub Neto

Conventional Monte Carlo simulations are stochastic in the sense that the acceptance of a trial move is decided by comparing a computed acceptance probability with a random number, uniformly distributed between 0 and 1. Here we consider the…

Statistical Mechanics · Physics 2018-05-24 Daan Frenkel , K. Julian Schrenk , Stefano Martiniani

Large scale discrete uniform and homogeneous $P$-values often arise in applications with multiple testing. For example, this occurs in genome wide association studies whenever a nonparametric one-sample (or two-sample) test is applied…

Methodology · Statistics 2021-12-08 Marta Cousido-Rocha , Jacobo de Uña-Álvarez , Sebastian Döhler

In oncology the efficacy of novel therapeutics often differs across patient subgroups, and these variations are difficult to predict during the initial phases of the drug development process. The relation between the power of randomized…

Methodology · Statistics 2025-06-05 Boyu Ren , Federico Ferrari , Sandra Fortini , Steffen Ventz , Lorenzo Trippa

A research frontier has emerged in scientific computation, wherein numerical error is regarded as a source of epistemic uncertainty that can be modelled. This raises several statistical challenges, including the design of statistical…

Machine Learning · Statistics 2017-10-19 François-Xavier Briol , Chris. J. Oates , Mark Girolami , Michael A. Osborne , Dino Sejdinovic

The quantum analogue of the equality function, known as the quantum state identity problem, is the task of deciding whether $n$ unknown quantum states are equal or unequal, given the promise that all states are either pairwise orthogonal or…

Quantum Physics · Physics 2026-04-15 Harry Buhrman , Dmitry Grinko , Philip Verduyn Lunel , Jordi Weggemans

We propose the density ratio permutation test, a hypothesis test that assesses whether the ratio between two densities is proportional to a known function based on independent samples from each distribution. The test uses an efficient…

Methodology · Statistics 2026-01-14 Alberto Bordino , Thomas B. Berrett

Bayesian predictive probabilities are commonly used for interim monitoring of clinical trials through efficacy and futility stopping rules. Despite their usefulness, calculation of predictive probabilities, particularly in pre-experiment…

Applications · Statistics 2024-06-18 Joe Marion , Liz Lorenzi , Cora Allen-Savietta , Scott Berry , Kert Viele

Recent advances have shown that statistical tests for the rank of cross-covariance matrices play an important role in causal discovery. These rank tests include partial correlation tests as special cases and provide further graphical…

Machine Learning · Computer Science 2025-06-13 Xinshuai Dong , Ignavier Ng , Boyang Sun , Haoyue Dai , Guang-Yuan Hao , Shunxing Fan , Peter Spirtes , Yumou Qiu , Kun Zhang

Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health…

Applications · Statistics 2018-11-29 Elias Chaibub Neto

We propose novel methodology for testing equality of model parameters between two high-dimensional populations. The technique is very general and applicable to a wide range of models. The method is based on sample splitting: the data is…

Methodology · Statistics 2013-01-17 Nicolas Städler , Sach Mukherjee

Verifying that a statistically significant result is scientifically meaningful is not only good scientific practice, it is a natural way to control the Type I error rate. Here we introduce a novel extension of the p-value - a…

Methodology · Statistics 2018-07-04 Jeffrey D. Blume , Lucy DAgostino McGowan , William D. Dupont , Robert A. Greevy

A ballot permutation is a permutation $\pi$ such that in any prefix of $\pi$ the descent number is not more than the ascent number. By using a reversal concatenation map, we give a formula for the joint distribution (pk, des) of the peak…

Combinatorics · Mathematics 2020-09-16 David G. L. Wang , T. Zhao

Sum-based global tests are highly popular in multiple hypothesis testing. In this paper we propose a general closed testing procedure for sum tests, which provides lower confidence bounds for the proportion of true discoveries (TDP),…

Methodology · Statistics 2023-04-21 Anna Vesely , Livio Finos , Jelle J. Goeman

Genetic investigations often involve the testing of vast numbers of related hypotheses simultaneously. To control the overall error rate, a substantial penalty is required, making it difficult to detect signals of moderate strength. To…

Methodology · Statistics 2010-10-25 Kathryn Roeder , Larry Wasserman

The cell biology literature is littered with erroneously tiny P values, often the result of evaluating individual cells as independent samples. Because readers use P values and error bars to infer whether a reported difference would likely…

Other Quantitative Biology · Quantitative Biology 2020-04-30 Samuel J. Lord , Katrina B. Velle , R. Dyche Mullins , Lillian K. Fritz-Laylin

Hypothesis tests based on linear models are widely accepted by organizations that regulate clinical trials. These tests are derived using strong assumptions about the data-generating process so that the resulting inference can be based on…

Applications · Statistics 2018-09-13 Kellie Ottoboni , Fraser Lewis , Luigi Salmaso

We consider one of the most basic multiple testing problems that compares expectations of multivariate data among several groups. As a test statistic, a conventional (approximate) $t$-statistic is considered, and we determine its rejection…

Methodology · Statistics 2016-12-20 Yoshiyuki Ninomiya , Satoshi Kuriki , Toshihiko Shiroishi , Toyoyuki Takada

In many applied sciences a popular analysis strategy for high-dimensional data is to fit many multivariate generalized linear models in parallel. This paper presents a novel approach to address the resulting multiple testing problem by…

Statistics Theory · Mathematics 2024-10-07 Riccardo De Santis , Jelle J. Goeman , Samuel Davenport , Jesse Hemerik , Livio Finos

Multivariate meta-analysis is gaining prominence in evidence synthesis research because it enables simultaneous synthesis of multiple correlated outcome data, and random-effects models have generally been used for addressing between-studies…

Methodology · Statistics 2021-07-14 Hisashi Noma , Kengo Nagashima , Toshi A. Furukawa