English
Related papers

Related papers: Wasserstein distance error bounds for the multivar…

200 papers

Parameter estimation is a fundamental challenge in machine learning, crucial for tasks such as neural network weight fitting and Bayesian inference. This paper focuses on the complexity of estimating translation $\boldsymbol{\mu} \in…

Machine Learning · Computer Science 2025-01-20 Valentio Iverson , Stephen Vavasis

Let $\mu_N$ be the empirical measure associated to a $N$-sample of a given probability distribution $\mu$ on $\mathbb{R}^d$. We are interested in the rate of convergence of $\mu_N$ to $\mu$, when measured in the Wasserstein distance of…

Probability · Mathematics 2013-12-10 Nicolas Fournier , Arnaud Guillin

This paper studies the estimation of high-dimensional, discrete, possibly sparse, mixture models in topic models. The data consists of observed multinomial counts of $p$ words across $n$ independent documents. In topic models, the $p\times…

Statistics Theory · Mathematics 2022-06-28 Xin Bing , Florentina Bunea , Seth Strimas-Mackey , Marten Wegkamp

Understanding proper distance measures between distributions is at the core of several learning tasks such as generative models, domain adaptation, clustering, etc. In this work, we focus on mixture distributions that arise naturally in…

Machine Learning · Computer Science 2019-10-30 Yogesh Balaji , Rama Chellappa , Soheil Feizi

In this paper, we obtain quantitative, non-asymptotic, and data-dependent \textit{Bernstein-von Mises type} bounds on the normal approximation of the posterior distribution in exponential family models with arbitrary centring and scaling.…

Statistics Theory · Mathematics 2025-01-14 Adrian Fischer , Robert E. Gaunt , Gesine Reinert , Yvik Swan

We extend the celebrated Stone's theorem to the framework of distributional regression. More precisely, we prove that weighted empirical distribution with local probability weights satisfying the conditions of Stone's theorem provide…

Statistics Theory · Mathematics 2023-02-03 Clément Dombry , Thibault Modeste , Romain Pic

We revisit Markowitz's mean-variance portfolio selection model by considering a distributionally robust version, where the region of distributional uncertainty is around the empirical measure and the discrepancy between probability measures…

Methodology · Statistics 2018-02-15 Jose Blanchet , Lin Chen , Xun Yu Zhou

Optimal transport and the Wasserstein distance $\mathcal{W}_p$ have recently seen a number of applications in the fields of statistics, machine learning, data science, and the physical sciences. These applications are however severely…

Statistics Theory · Mathematics 2024-05-24 Ruiyu Han , Cynthia Rush , Johannes Wiesel

Bayesian inference typically requires the computation of an approximation to the posterior distribution. An important requirement for an approximate Bayesian inference algorithm is to output high-accuracy posterior mean and uncertainty…

Statistics Theory · Mathematics 2018-10-03 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

We provide explicit bounds on the Wasserstein distance between discrete time martingales and the standard normal distribution. The proofs are based on a combination of Lindeberg's and Stein's method.

Probability · Mathematics 2018-08-14 Adrian Röllin

We derive generalization error bounds for the training of two-layer neural networks without assuming boundedness of the loss function, using Wasserstein distance estimates on the discrepancy between a probability distribution and its…

Machine Learning · Statistics 2026-04-09 Jiang Yu Nguwi , Nicolas Privault

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We study the non-uniformity of probability measures on the interval and the circle. On the interval, we identify the Wasserstein-$p$ distance with the classical $L^p$-discrepancy. We thereby derive sharp estimates in Wasserstein distances…

Classical Analysis and ODEs · Mathematics 2019-11-01 Cole Graham

For martingales with a wide range of integrability, we will quantify the rate of convergence of the central limit theorem via Wasserstein distances of order $r$, $1\le r\le 3$. Our bounds are in terms of Lyapunov's coefficients and the…

Probability · Mathematics 2024-07-25 Xiaoqin Guo

This paper presents a unified approach based on Wasserstein distance to derive concentration bounds for empirical estimates for two broad classes of risk measures defined in the paper. The classes of risk measures introduced include as…

Statistics Theory · Mathematics 2022-05-11 Prashanth L. A. , Sanjay P. Bhat

We study the weighted total variation distance between probability measures. Using Fourier-analytic tools, we present estimates in terms of Wasserstein distances between the respective probabilities, under appropriate smoothness and moment…

Probability · Mathematics 2025-06-23 Iván Ivkovic , Miklós Rásonyi

This work presents several expected generalization error bounds based on the Wasserstein distance. More specifically, it introduces full-dataset, single-letter, and random-subset bounds, and their analogues in the randomized subsample…

Machine Learning · Statistics 2022-03-29 Borja Rodríguez-Gálvez , Germán Bassi , Ragnar Thobaben , Mikael Skoglund

Bayesian optimal experimental design (OED) provides a principled framework for selecting observations or experiments. We introduce new Bayesian design criteria based on the expected Wasserstein-$p$ distance between the prior and posterior…

Methodology · Statistics 2026-05-28 Tapio Helin , Youssef Marzouk , Jose Rodrigo Rojo-Garcia

We provide some non asymptotic bounds, with explicit constants, that measure the rate of convergence, in expected Wasserstein distance, of the empirical measure associated to an i.i.d. $N$-sample of a given probability distribution on…

Probability · Mathematics 2023-03-15 Nicolas Fournier

We study the approximation of a (finite) continuous-time Markov chain by a Markov chain on a reduced state space, and we provide formal error bounds for the approximated transient distributions in the Wasserstein distance. These bounds…

Probability · Mathematics 2025-12-19 Fabian Michel