English
Related papers

Related papers: Two-sample KS test with approxQuantile in Apache S…

200 papers

The Kolmogorov-Smirnov (KS) test is a nonparametric statistical test used to test for differences between univariate probability distributions. The versatility of the KS test has made it a cornerstone of statistical analysis across many…

Methodology · Statistics 2022-11-21 Connor Puritz , Elan Ness-Cohn , Rosemary Braun

The two-sample Kolmogorov-Smirnov test is a widely used statistical test for detecting whether two samples are likely to come from the same distribution. Implementations typically recur on an article of Hodges from 1957. The advances in…

Computation · Statistics 2021-09-27 Thomas Viehmann

Big Data has become an ever more commonplace setting that is encountered by data analysts. In the Big Data setting, analysts are faced with very large numbers of observations as well as data that arrive as a stream, both of which are…

Computation · Statistics 2017-04-13 Hien Duy Nguyen

The cumulative distribution and quantile functions for the one-sided one sample Kolmogorov-Smirnov probability distributions are used for goodness-of-fit testing. While the Smirnov-Birnbaum-Tingey formula for the CDF appears straight…

Computation · Statistics 2018-02-21 Paul van Mulbregt

This paper investigates the estimation of the self-similarity parameter in fractional processes. We re-examine the Kolmogorov-Smirnov (KS) test as a distribution-based method for assessing self-similarity, emphasizing its robustness and…

Methodology · Statistics 2025-02-12 Daniele Angelini , Sergio Bianchi

Statistical testing is widespread and critical for a variety of scientific disciplines. The advent of machine learning and the increase of computing power has increased the interest in the analysis and statistical testing of…

Computation · Statistics 2021-06-28 Alex Hagen , Shane Jackson , James Kahn , Jan Strube , Isabel Haide , Karl Pazdernik , Connor Hainje

The cumulative distribution and quantile functions for the two-sided one sample Kolmogorov-Smirnov probability distributions are used for goodness-of-fit testing. The CDF is notoriously difficult to explicitly describe and to compute, and…

Computation · Statistics 2018-03-02 Paul van Mulbregt

When comparing two distributions, it is often helpful to learn at which quantiles or values there is a statistically significant difference. This provides more information than the binary "reject" or "do not reject" decision of a global…

Statistics Theory · Mathematics 2018-08-16 Matt Goldman , David M. Kaplan

We present an extension of the Kolmogorov-Smirnov (KS) two-sample test, which can be more sensitive to differences in the tails. Our test statistic is an integral probability metric (IPM) defined over a higher-order total variation ball,…

Machine Learning · Statistics 2019-03-26 Veeranjaneyulu Sadhanala , Yu-Xiang Wang , Aaditya Ramdas , Ryan J. Tibshirani

Empirical cumulative distribution functions (ECDFs) have been used to test the hypothesis that two samples come from the same distribution since the seminal contribution by Kolmogorov and Smirnov. This paper describes a statistic which is…

Methodology · Statistics 2020-07-06 Connor Dowd

One of the major problems in Machine Learning (ML) and Artificial Intelligence (AI) is the fact that the probability distribution of the test data in the real world could deviate substantially from the probability distribution of the…

Machine Learning · Computer Science 2025-10-21 Ozan K. Tonguz , Federico Taschin

We propose a framework for analyzing and comparing distributions, allowing us to design statistical tests to determine if two samples are drawn from different distributions. Our test statistic is the largest difference in expectations over…

Machine Learning · Computer Science 2008-05-16 Arthur Gretton , Karsten Borgwardt , Malte J. Rasch , Bernhard Scholkopf , Alexander J. Smola

One of the most fundamental problems in distribution testing is the identity testing problem: given samples $x_1,\ldots,x_s$, the goal is to determine whether the samples are drawn from a target distribution $\mathcal{D}$. When…

Quantum Physics · Physics 2026-05-15 Bruno Cavalar , Eli Goldin , Matthew Gray , Taiga Hiroka , Min-Hsiu Hsieh , Tomoyuki Morimae

We propose a novel test procedure for comparing mean functions across two groups within the reproducing kernel Hilbert space (RKHS) framework. Our proposed method is adept at handling sparsely and irregularly sampled functional data when…

Methodology · Statistics 2025-01-29 Chi Zhang , Peijun Sang , Yingli Qin

We analyzed the effect of the deviation of the exact distribution of the p-values from the uniform distribution on the Kolmogorov-Smirnov (K-S) test that was implemented as the second-level randomness test. We derived an inequality that…

Methodology · Statistics 2021-10-18 Akihiro Yamaguchi , Asaki Saito

The Kolmogorov--Smirnov (KS) test is a widely used statistical test that assesses the conformity of a sample to a specified distribution. Its efficacy, however, diminishes with serially dependent data and when parameters within the…

Methodology · Statistics 2025-11-11 Mathew Chandy , Elizabeth Schifano , Jun Yan , Xianyang Zhang

In recent years, Bayesian nonparametric statistics has gathered extraordinary attention. Nonetheless, a relatively little amount of work has been expended on Bayesian nonparametric hypothesis testing. In this paper, a novel Bayesian…

Statistics Theory · Mathematics 2015-05-08 Luai Al Labadi , Emad Masuadi , Mahmoud Zarepour

This paper considers the problem of testing the equality of two unspecified distributions. The classical omnibus tests such as the Kolmogorov-Smirnov and Cram\`er-von Mises are known to suffer from low power against essentially all but…

Statistics Theory · Mathematics 2015-09-15 Wen-Xin Zhou , Chao Zheng , Zhen Zhang

Two-sample tests are important in statistics and machine learning, both as tools for scientific discovery as well as to detect distribution shifts. This led to the development of many sophisticated test procedures going beyond the standard…

Machine Learning · Computer Science 2023-01-18 Jonas M. Kübler , Vincent Stimper , Simon Buchholz , Krikamol Muandet , Bernhard Schölkopf

Classical tests are available for the two-sample test of correspondence of distribution functions. From these, the Kolmogorov-Smirnov test provides also the graphical interpretation of the test results, in different forms. Here, we propose…

Methodology · Statistics 2026-01-27 Konstantinos Konstantinou , Tomáš Mrkvička , Mari Myllymäki
‹ Prev 1 2 3 10 Next ›