English
Related papers

Related papers: Characterization of probability distribution conve…

200 papers

We study the non-uniformity of probability measures on the interval and the circle. On the interval, we identify the Wasserstein-$p$ distance with the classical $L^p$-discrepancy. We thereby derive sharp estimates in Wasserstein distances…

Classical Analysis and ODEs · Mathematics 2019-11-01 Cole Graham

Quantization for probability distributions refers broadly to estimating a given probability measure by a discrete probability measure supported by a finite number of points. We consider general geometric approaches to quantization using…

Dynamical Systems · Mathematics 2020-02-11 Joseph Rosenblatt , Mrinal Kanti Roychowdhury

We study the convergence rate of the optimal quantization for a probability measure sequence $(\mu_{n})_{n\in\mathbb{N}^{*}}$ on $\mathbb{R}^{d}$ converging in the Wasserstein distance in two aspects: the first one is the convergence rate…

Statistics Theory · Mathematics 2020-02-20 Yating Liu , Gilles Pagès

Random probabilities are a key component to many nonparametric methods in Statistics and Machine Learning. To quantify comparisons between different laws of random probabilities several works are starting to use the elegant Wasserstein over…

Statistics Theory · Mathematics 2024-05-27 Marta Catalano , Hugo Lavenant

Impractical assumptions, an inherently myopic nature, and the crucial role of the initial design, all together contribute to making theoretical convergence proofs of little value in real-life Bayesian Optimization applications. In this…

Optimization and Control · Mathematics 2026-02-13 Antonio Candelieri , Francesco Archetti

Optimal transport and the Wasserstein distance $\mathcal{W}_p$ have recently seen a number of applications in the fields of statistics, machine learning, data science, and the physical sciences. These applications are however severely…

Statistics Theory · Mathematics 2024-05-24 Ruiyu Han , Cynthia Rush , Johannes Wiesel

In this article, we study the approximation of a probability measure $\mu$ on $\mathbb{R}^{d}$ by its empirical measure $\hat{\mu}_{N}$ interpreted as a random quantization. As error criterion we consider an averaged $p$-th moment…

Probability · Mathematics 2011-08-29 Steffen Dereich , Michael Scheutzow , Reik Schottstedt

The likelihood function is a fundamental component in Bayesian statistics. However, evaluating the likelihood of an observation is computationally intractable in many applications. In this paper, we propose a non-parametric approximation of…

Machine Learning · Computer Science 2019-10-24 Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh , Man-Chung Yue , Daniel Kuhn , Wolfram Wiesemann

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

The aim of this article is to write the $p$-Wasserstein metric $W_p$ with the $p$-norm, $p\in [1,\infty)$, on $\R^d$ in terms of copula. In particular for the case of one-dimensional distributions, we get that the copula employed to get the…

Statistics Theory · Mathematics 2024-10-29 Mariem Abdellatif , Peter Kuching , Barbara Rüdiger , Irene Ventura

Given a prior probability density $p$ on a compact set $K$ we characterize the probability distribution $q_{\delta}^*$ on $K$ contained in a Wasserstein ball $B_{\delta}(\mu)$ centered in a given discrete measure $\mu$ for which the…

Optimization and Control · Mathematics 2021-06-08 Luis Felipe Vargas , Mauricio Velasco

Estimating a $d$-dimensional distribution $\mu$ by the empirical measure $\hat{\mu}_n$ of its samples is an important task in probability theory, statistics and machine learning. It is well known that $\mathbb{E}[\mathcal{W}_p(\hat{\mu}_n,…

Probability · Mathematics 2026-03-24 Martin Larsson , Jonghwa Park , Johannes Wiesel

In the past couple of years, various approaches to representing and quantifying different types of predictive uncertainty in machine learning, notably in the setting of classification, have been proposed on the basis of second-order…

Machine Learning · Computer Science 2023-12-05 Yusuf Sale , Viktor Bengs , Michele Caprio , Eyke Hüllermeier

The purpose of quantization for a probability distribution is to estimate the probability by a discrete probability with finite support. In this paper, a nonuniform probability measure $P$ on $\mathbb R^2$ which has support the Sierpi\'nski…

Information Theory · Computer Science 2023-06-29 Mrinal Kanti Roychowdhury

We are interested in the Wasserstein distance between two probability measures on $\R^n$ sharing the same copula $C$. The image of the probability measure $dC$ by the vectors of pseudo-inverses of marginal distributions is a natural…

Probability · Mathematics 2013-07-17 Aurélien Alfonsi , Benjamin Jourdain

The quantization scheme in probability theory deals with finding a best approximation of a given probability distribution by a probability distribution that is supported on finitely many points. For a given $k\geq 2$, let $\{S_j : 1\leq…

Dynamical Systems · Mathematics 2019-11-22 Mrinal Kanti Roychowdhury

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

Statistics Theory · Mathematics 2022-02-15 Vincent Divol

We give a new characterization of relative entropy, also known as the Kullback-Leibler divergence. We use a number of interesting categories related to probability theory. In particular, we consider a category FinStat where an object is a…

Information Theory · Computer Science 2017-08-22 John C. Baez , Tobias Fritz

The central limit theorem (CLT) is one of the most fundamental results in probability; and establishing its rate of convergence has been a key question since the 1940s. For independent random variables, a series of recent works established…

Probability · Mathematics 2023-09-12 Tianle Liu , Morgane Austern

The quantization problem aims to find the best possible approximation of probability measures on ${\mathbb{R}}^d$ using finite, discrete measures. The Wasserstein distance is a typical choice to measure the quality of the approximation.…

Probability · Mathematics 2023-09-11 Rajmadan Lakshmanan , Alois Pichler