English
Related papers

Related papers: Learning with minibatch Wasserstein : asymptotic a…

200 papers

Motivated by the growing popularity of variants of the Wasserstein distance in statistics and machine learning, we study statistical inference for the Sliced Wasserstein distance--an easily computable variant of the Wasserstein distance.…

Statistics Theory · Mathematics 2022-04-05 Tudor Manole , Sivaraman Balakrishnan , Larry Wasserman

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

Machine Learning · Computer Science 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Many applications in machine learning involve data represented as probability distributions. The emergence of such data requires radically novel techniques to design tractable gradient flows on probability distributions over this type of…

Machine Learning · Computer Science 2025-06-10 Clément Bonet , Christophe Vauthier , Anna Korba

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

Machine Learning · Computer Science 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

A generalization of the Wasserstein metric, the integrated transportation distance, establishes a novel distance between probability kernels of Markov systems. This metric serves as the foundation for an efficient approximation technique,…

Machine Learning · Computer Science 2023-12-07 Zhengqi Lin , Andrzej Ruszczynski

Optimal transport (\OT) theory defines a powerful set of tools to compare probability distributions. \OT~suffers however from a few drawbacks, computational and statistical, which have encouraged the proposal of several regularized variants…

Machine Learning · Statistics 2019-10-29 Tam Le , Makoto Yamada , Kenji Fukumizu , Marco Cuturi

(Mini-batch) Stochastic Gradient Descent is a popular optimization method which has been applied to many machine learning applications. But a rather high variance introduced by the stochastic gradient in each step may slow down the…

Machine Learning · Computer Science 2018-10-09 Jingchang Liu , Linli Xu

Random measures provide flexible parameters for Bayesian nonparametric models. Given two different priors for a random measure, we develop a natural framework to investigate the rate at which the corresponding posteriors merge, as the…

Statistics Theory · Mathematics 2025-09-17 Marta Catalano , Hugo Lavenant

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

This paper focuses on a similarity measure, known as the Wasserstein distance, with which to compare images. The Wasserstein distance results from a partial differential equation (PDE) formulation of Monge's optimal transport problem. We…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Michael Snow , Jan Van lent

Existing approaches to depth or disparity estimation output a distribution over a set of pre-defined discrete values. This leads to inaccurate results when the true depth or disparity does not match any of these values. The fact that this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Divyansh Garg , Yan Wang , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger , Wei-Lun Chao

Wasserstein barycenters provide a principled approach for aggregating probability measures, while preserving the geometry of their ambient space. Existing discrete methods are not scalable as they assume access to the complete set of…

Machine Learning · Statistics 2026-03-10 Eduardo Fernandes Montesuma , Yassir Bendou , Mike Gartrell

We propose a fast algorithm for the calculation of the Wasserstein-1 distance, which is a particular type of optimal transport distance with homogeneous of degree one transport cost. Our algorithm is built on multilevel primal-dual…

Computation · Statistics 2019-08-06 Jialin Liu , Wotao Yin , Wuchen Li , Yat Tin Chow

Approximate inference in complex probabilistic models such as deep Gaussian processes requires the optimisation of doubly stochastic objective functions. These objectives incorporate randomness both from mini-batch subsampling of the data…

Machine Learning · Statistics 2020-03-26 Ayman Boustati , Sattar Vakili , James Hensman , ST John

Wasserstein GANs are based on the idea of minimising the Wasserstein distance between a real and a generated distribution. We provide an in-depth mathematical analysis of differences between the theoretical setup and the reality of training…

Machine Learning · Statistics 2021-10-06 Jan Stanczuk , Christian Etmann , Lisa Maria Kreusser , Carola-Bibiane Schönlieb

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

Statistics Theory · Mathematics 2022-02-15 Vincent Divol

We propose a new unsupervised anomaly detection method based on the sliced-Wasserstein distance for training data selection in machine learning approaches. Our filtering technique is interesting for decision-making pipelines deploying…

Machine Learning · Computer Science 2025-04-18 Julien Pallage , Antoine Lesage-Landry

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

Machine Learning · Computer Science 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros

We propose a new statistical model, the spiked transport model, which formalizes the assumption that two probability distributions differ only on a low-dimensional subspace. We study the minimax rate of estimation for the Wasserstein…

Statistics Theory · Mathematics 2019-09-18 Jonathan Niles-Weed , Philippe Rigollet

We present a novel method for efficiently computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces. Our approach uses conditional normalizing flows to approximate the input distributions as invertible…

Machine Learning · Statistics 2025-05-29 Gabriele Visentin , Patrick Cheridito