English
Related papers

Related papers: Using Kolmogorov-Smirnov Distance for Measuring Di…

200 papers

Message identification (M-I) divergence is an important measure of the information distance between probability distributions, similar to Kullback-Leibler (K-L) and Renyi divergence. In fact, M-I divergence with a variable parameter can…

Information Theory · Computer Science 2024-04-08 Rui She , Shanyun Liu , Pingyi Fan

In this paper we propose two behavioral distances that support approximate reasoning on Stochastic Markov Models (SMMs), that are continuous-time stochastic transition systems where the residence time on each state is described by a generic…

Formal Languages and Automata Theory · Computer Science 2014-03-26 Giorgio Bacci , Giovanni Bacci , Kim G. Larsen , Radu Mardare

Suppose we have a sample from a distribution $D$ and we want to test whether $D = D^*$ for a fixed distribution $D^*$. Specifically, we want to reject with constant probability, if the distance of $D$ from $D^*$ is $\geq \varepsilon$ in a…

Data Structures and Algorithms · Computer Science 2024-10-30 Christian Janos Lebeda , Jakub Tětek

We consider the problem of statistical inference for the S distribution and introduce new minimum distance estimators for the four parameters of the S distribution using Kolmogorov-Smirnov, Cramer-von Mises and related distance metrics.…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Sergej V. Aksenov , Michael A. Savageau

The classical two-sample test of Kolmogorov-Smirnov (KS) is widely used to test whether empirical samples come from the same distribution. Even though most statistical packages provide an implementation, carrying out the test in big data…

Computation · Statistics 2023-12-18 Bradley Eck , Duygu Kabakci-Zorlu , Amadou Ba

Machine learning models assume that training and test samples are drawn from the same distribution. As such, significant differences between training and test distributions often lead to degradations in performance. We introduce Multiple…

Ensuring the reliability and safety of automated decision-making is crucial. It is well-known that data distribution shifts in machine learning can produce unreliable outcomes. This paper proposes a new approach for measuring the…

Machine Learning · Computer Science 2024-08-14 Daniel Sikar , Artur Garcez , Tillman Weyde , Robin Bloomfield , Kaleem Peeroo

This paper proposes confidence regions for the identified set in conditional moment inequality models using Kolmogorov-Smirnov statistics with a truncated inverse variance weighting with increasing truncation points. The new weighting…

Applications · Statistics 2011-12-06 Timothy B. Armstrong

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

K-means algorithm is a very popular clustering algorithm which is famous for its simplicity. Distance measure plays a very important rule on the performance of this algorithm. We have different distance measure techniques available. But…

Machine Learning · Computer Science 2014-05-30 Mr. Dibya Jyoti Bora , Dr. Anil Kumar Gupta

The use of Machine Learning (ML) and Artificial Intelligence (AI) in smart transportation networks has increased significantly in the last few years. Among these ML and AI approaches, Reinforcement Learning (RL) has been shown to be a very…

Artificial Intelligence · Computer Science 2025-09-22 Federico Taschin , Abderrahmane Lazaraq , Ozan K. Tonguz , Inci Ozgunes

Bias evaluation is fundamental to trustworthy AI, both in terms of checking data quality and in terms of checking the outputs of AI systems. In testing data quality, for example, one may study the distance of a given dataset, viewed as a…

Machine Learning · Computer Science 2025-06-12 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

We study change point detection and localization for univariate data in fully nonparametric settings in which, at each time point, we acquire an i.i.d. sample from an unknown distribution. We quantify the magnitude of the distributional…

Methodology · Statistics 2019-05-27 Oscar Hernan Madrid Padilla , Yi Yu , Daren Wang , Alessandro Rinaldo

The cumulative distribution and quantile functions for the one-sided one sample Kolmogorov-Smirnov probability distributions are used for goodness-of-fit testing. While the Smirnov-Birnbaum-Tingey formula for the CDF appears straight…

Computation · Statistics 2018-02-21 Paul van Mulbregt

Ensuring safety and explainability of machine learning (ML) is a topic of increasing relevance as data-driven applications venture into safety-critical application domains, traditionally committed to high safety standards that are not…

Machine Learning · Computer Science 2020-05-28 Koorosh Aslansefat , Ioannis Sorokos , Declan Whiting , Ramin Tavakoli Kolagari , Yiannis Papadopoulos

Unpredictable ML model behavior on unseen data, especially in the health domain, raises serious concerns about its safety as repercussions for mistakes can be fatal. In this paper, we explore the feasibility of using state-of-the-art…

Machine Learning · Computer Science 2021-10-28 Chunjong Park , Anas Awadalla , Tadayoshi Kohno , Shwetak Patel

Here I present the analytic form of two common distance metrics, the symmetrised Kullback-Leibler Divergence and the Kolmogorov-Smirnov statistic, as well as an extension of the Kolmogorov-Smirnov statistic for comparing theoretical gamma…

Statistics Theory · Mathematics 2018-02-06 Colin M. McCrimmon

This study introduces the Misclassification Likelihood Matrix (MLM) as a novel tool for quantifying the reliability of neural network predictions under distribution shifts. The MLM is obtained by leveraging softmax outputs and clustering…

We show how to improve the discrepancy of an iid sample by moving only a few points. Specifically, modifying \( O(m) \) sample points on average reduces the Kolmogorov-Smirnov distance to the population distribution to \(1/m\).

Statistics Theory · Mathematics 2025-09-15 Gleb Smirnov , Roman Vershynin

Computer vision systems for automatic image categorization have become accurate and reliable enough that they can run continuously for days or even years as components of real-world commercial applications. A major open problem in this…

Machine Learning · Statistics 2019-10-01 Rémy Sun , Christoph H. Lampert