English
Related papers

Related papers: Tighter expected generalization error bounds via W…

200 papers

In this article we study generalization of the classical Talagrand transport-entropy inequality in which the Wasserstein distance is replaced by the entropic transportation cost. This class of inequalities has been introduced in the recent…

Probability · Mathematics 2019-07-02 Giovanni Conforti , Luigia Ripani

We introduce a distortion measure for images, Wasserstein distortion, that simultaneously generalizes pixel-level fidelity on the one hand and realism or perceptual quality on the other. We show how Wasserstein distortion reduces to a pure…

Information Theory · Computer Science 2024-04-01 Yang Qiu , Aaron B. Wagner , Johannes Ballé , Lucas Theis

Heisenberg's uncertainty principle has recently led to general measurement uncertainty relations for quantum systems: incompatible observables can be measured jointly or in sequence only with some unavoidable approximation, which can be…

Quantum Physics · Physics 2017-06-27 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

We study the problem of reconstructing the latent geometry of a $d$-dimensional Riemannian manifold from a random geometric graph. While recent works have made significant progress in manifold recovery from random geometric graphs, and more…

Machine Learning · Statistics 2026-04-02 Han Huang , Pakawut Jiradilok , Elchanan Mossel

The theory of optimal transport of probability measures has wide-ranging applications across a number of different fields, including concentration of measure, machine learning, Markov chains, and economics. The generalisation of optimal…

Quantum Physics · Physics 2026-04-21 Emily Beatty

In this work, we propose a novel generalized Wasserstein-2 distance approach for efficiently training stochastic neural networks to reconstruct random field models, where the target random variable comprises both continuous and categorical…

Machine Learning · Computer Science 2025-07-08 Mingtao Xia , Qijing Shen

We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical…

Machine Learning · Computer Science 2022-01-04 Aolin Xu

We provide a new information-theoretic generalization error bound that is exactly tight (i.e., matching even the constant) for the canonical quadratic Gaussian (location) problem. Most existing bounds are order-wise loose in this setting,…

Information Theory · Computer Science 2023-11-14 Ruida Zhou , Chao Tian , Tie Liu

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Optimization over the space of probability measures endowed with the Wasserstein-2 geometry is central to modern machine learning and mean-field modeling. However, traditional methods relying on full Wasserstein gradients often suffer from…

Machine Learning · Statistics 2026-04-03 Yewei Xu , Qin Li

Understanding proper distance measures between distributions is at the core of several learning tasks such as generative models, domain adaptation, clustering, etc. In this work, we focus on mixture distributions that arise naturally in…

Machine Learning · Computer Science 2019-10-30 Yogesh Balaji , Rama Chellappa , Soheil Feizi

Minimum expected distance estimation (MEDE) algorithms have been widely used for probabilistic models with intractable likelihood functions and they have become increasingly popular due to their use in implicit generative modeling (e.g.…

Machine Learning · Statistics 2020-03-25 Kimia Nadjahi , Alain Durmus , Umut Şimşekli , Roland Badeau

The autocovariance and cross-covariance functions naturally appear in many time series procedures (e.g., autoregression or prediction). Under assumptions, empirical versions of the autocovariance and cross-covariance are asymptotically…

Statistics Theory · Mathematics 2023-05-09 Andreas Anastasiou , Tobias Kley

We study a class of quadratic Wasserstein distances on spaces consisting of generalized dynamical systems on a von Neumann algebra. We emphasize how symmetry of such a Wasserstein distance arises, but also study the asymmetric case. This…

Operator Algebras · Mathematics 2024-11-05 Rocco Duvenhage

Distributed systems require fusing heterogeneous local probability distributions into a global summary over sparse and unreliable communication networks. Traditional consensus algorithms, which average distributions in Euclidean space,…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Ali Baheri , Alireza Vahid

The Wasserstein distance between probability measures on compact spaces provides a natural invariant quantitative measure of equidistribution, which is partly similar to the classical discrepancy appearing in Erd\"os-Tur\'an type…

Number Theory · Mathematics 2025-07-29 Emmanuel Kowalski , Théo Untrau

We derive upper bounds on the Wasserstein distance ($W_1$), with respect to $\sup$-norm, between any continuous $\mathbb{R}^d$ valued random field indexed by the $n$-sphere and the Gaussian, based on Stein's method. We develop a novel…

Probability · Mathematics 2024-05-02 Krishnakumar Balasubramanian , Larry Goldstein , Nathan Ross , Adil Salim

Generative networks have experienced great empirical successes in distribution learning. Many existing experiments have demonstrated that generative networks can generate high-dimensional complex data from a low-dimensional easy-to-sample…

Machine Learning · Statistics 2023-02-28 Biraj Dahal , Alex Havrilla , Minshuo Chen , Tuo Zhao , Wenjing Liao

A number of researchers have independently introduced topologies on the set of laws of stochastic processes that extend the usual weak topology. Depending on the respective scientific background this was motivated by applications and…

Probability · Mathematics 2021-05-18 Julio Backhoff , Daniel Bartl , Mathias Beiglböck , Johannes Wiesel

The empirical Wasserstein projection (WP) distance quantifies the Wasserstein distance from the empirical distribution to a set of probability measures satisfying given expectation constraints. The WP is a powerful tool because it mitigates…

Statistics Theory · Mathematics 2024-08-22 Sirui Lin , Jose Blanchet , Peter Glynn , Viet Anh Nguyen