English
Related papers

Related papers: Comparing distributions by multiple testing across…

200 papers

One of the most fundamental problems in distribution testing is the identity testing problem: given samples $x_1,\ldots,x_s$, the goal is to determine whether the samples are drawn from a target distribution $\mathcal{D}$. When…

Quantum Physics · Physics 2026-05-15 Bruno Cavalar , Eli Goldin , Matthew Gray , Taiga Hiroka , Min-Hsiu Hsieh , Tomoyuki Morimae

Classical tests of fit typically reject a model for large enough real data samples. In contrast, often in statistical practice a model offers a good description of the data even though it is not the "true" random generator. We consider a…

Statistics Theory · Mathematics 2019-11-22 Eustasio del Barrio , Hristo Inouzhe , Carlos Matrán

In this paper, we consider the problem of simultaneously testing many two-sided hypotheses when rejections of null hypotheses are accompanied by claims of the direction of the alternative. The fundamental goal is to construct methods that…

Statistics Theory · Mathematics 2017-03-21 Anjana Grandhi , Wenge Guo , Joseph P. Romano

Goodness-of-fit tests are often used in data analysis to test the agreement of a distribution to a set of data. These tests can be used to detect an unknown signal against a known background or to set limits on a proposed signal…

Methodology · Statistics 2023-03-20 Lolian Shtembari , Allen Caldwell

Consider $n$ iid random variables, where $\xi_1, \ldots, \xi_n$ are $n$ realisations of a random variable $\xi$ and $\zeta_1, \ldots, \zeta_n$ are $n$ realisations of a random variable $\zeta$. The distribution of each realisation of $\xi$,…

Probability · Mathematics 2018-03-06 Tommy Liu

Diagnostic accuracy studies assess sensitivity and specificity of a new index test in relation to an established comparator or the reference standard. The development and selection of the index test is usually assumed to be conducted prior…

Methodology · Statistics 2022-08-30 Max Westphal , Antonia Zapf

Quantile regression is used to study effects of covariates on a particular quantile of the data distribution. Here we are interested in the question whether a covariate has any effect on the entire data distribution, i.e., on any of the…

Methodology · Statistics 2026-01-23 Tomáš Mrkvička , Konstantinos Konstantinou , Mikko Kuronen , Mari Myllymäki

Consider a set of multivariate distributions, $F_1,\dots,F_M$, aiming to explain the same phenomenon. For instance, each $F_m$ may correspond to a different candidate background model for calibration data, or to one of many possible signal…

Methodology · Statistics 2022-04-06 Sara Algeri

The Kolmogorov-Smirnov (KS) test is a nonparametric statistical test used to test for differences between univariate probability distributions. The versatility of the KS test has made it a cornerstone of statistical analysis across many…

Methodology · Statistics 2022-11-21 Connor Puritz , Elan Ness-Cohn , Rosemary Braun

We propose a sequential nonparametric test for detecting a change in distribution, based on windowed Kolmogorov--Smirnov statistics. The approach is simple, robust, highly computationally efficient, easy to calibrate, and requires no…

Methodology · Statistics 2016-12-26 Oscar Hernan Madrid Padilla , Alex Athey , Alex Reinhart , James G. Scott

We consider clinical trials with multiple, overlapping patient populations, that test multiple treatment policies specifically tailored to these populations. Such designs may lead to multiplicity issues, as false statements will affect…

Methodology · Statistics 2025-11-13 Remi Luschei , Werner Brannath

When comparing multiple groups in clinical trials, we are not only interested in whether there is a difference between any groups but rather the location. Such research questions lead to testing multiple individual hypotheses. To control…

We propose novel kernel-based tests for assessing the equivalence between distributions. Traditional goodness-of-fit testing is inappropriate for concluding the absence of distributional differences, because failure to reject the null…

Machine Learning · Statistics 2026-03-17 Xing Liu , Axel Gandy

The Kolmogorov--Smirnov (KS) test is a widely used statistical test that assesses the conformity of a sample to a specified distribution. Its efficacy, however, diminishes with serially dependent data and when parameters within the…

Methodology · Statistics 2025-11-11 Mathew Chandy , Elizabeth Schifano , Jun Yan , Xianyang Zhang

Model misspecification can create significant challenges for the implementation of probabilistic models, and this has led to development of a range of robust methods which directly account for this issue. However, whether these more…

Machine Learning · Statistics 2025-04-22 Oscar Key , Arthur Gretton , François-Xavier Briol , Tamara Fernandez

A goodness-of-fit test for one-parameter count distributions with finite second moment is proposed. The test statistic is derived from the $L^1$ distance of a function of the probability generating function of the model under the null…

Statistics Theory · Mathematics 2024-06-11 Antonio Di Noia , Lucio Barabesi , Marzia Marcheselli , Caterina Pisani , Luca Pratelli

The objective of goodness-of-fit testing is to assess whether a dataset of observations is likely to have been drawn from a candidate probability distribution. This paper presents a rank-based family of goodness-of-fit tests that is…

Statistics Theory · Mathematics 2019-04-18 Feras A. Saad , Cameron E. Freer , Nathanael L. Ackerman , Vikash K. Mansinghka

This paper considers the problem of testing the equality of two unspecified distributions. The classical omnibus tests such as the Kolmogorov-Smirnov and Cram\`er-von Mises are known to suffer from low power against essentially all but…

Statistics Theory · Mathematics 2015-09-15 Wen-Xin Zhou , Chao Zheng , Zhen Zhang

The classical two-sample test of Kolmogorov-Smirnov (KS) is widely used to test whether empirical samples come from the same distribution. Even though most statistical packages provide an implementation, carrying out the test in big data…

Computation · Statistics 2023-12-18 Bradley Eck , Duygu Kabakci-Zorlu , Amadou Ba

This paper deals with two-sample Kolmogorov-Smirnov test and its biasedness. This test is not unbiased in general in case of different sample sizes. We found out most biased distribution for some values of significance level $\alpha$.…

Other Statistics · Statistics 2011-06-29 Peter Bubelíny