English
Related papers

Related papers: Learning with minibatch Wasserstein : asymptotic a…

200 papers

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

The main objective of this study is to propose an optimal transport based semi-supervised approach to learn from scarce labelled image data using deep convolutional networks. The principle lies in implicit graph-based transductive…

Machine Learning · Computer Science 2025-12-08 Antoine Blais , Nicolas Couëllan

The Wasserstein metric is an important measure of distance between probability distributions, with applications in machine learning, statistics, probability theory, and data analysis. This paper provides upper and lower bounds on…

Statistics Theory · Mathematics 2019-11-11 Shashank Singh , Barnabás Póczos

This paper introduces Wasserstein variational inference, a new form of approximate Bayesian inference based on optimal transport theory. Wasserstein variational inference uses a new family of divergences that includes both f-divergences and…

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances…

Machine Learning · Statistics 2014-06-18 Marco Cuturi , Arnaud Doucet

Many machine learning problems can be seen as approximating a \textit{target} distribution using a \textit{particle} distribution by minimizing their statistical discrepancy. Wasserstein Gradient Flow can move particles along a path that…

Machine Learning · Statistics 2024-06-07 Song Liu , Jiahao Yu , Jack Simons , Mingxuan Yi , Mark Beaumont

In this paper, we study the problem of learning compact (low-dimensional) representations for sequential data that captures its implicit spatio-temporal cues. To maximize extraction of such informative cues from the data, we set the problem…

Machine Learning · Computer Science 2020-07-14 Anoop Cherian , Shuchin Aeron

Statistical inference can be performed by minimizing, over the parameter space, the Wasserstein distance between model distributions and the empirical distribution of the data. We study asymptotic properties of such minimum Wasserstein…

Methodology · Statistics 2019-05-13 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

We present Optimal Transport GAN (OT-GAN), a variant of generative adversarial nets minimizing a new metric measuring the distance between the generator distribution and the data distribution. This metric, which we call mini-batch energy…

Machine Learning · Computer Science 2018-03-16 Tim Salimans , Han Zhang , Alec Radford , Dimitris Metaxas

This paper is focused on the study of entropic regularization in optimal transport as a smoothing method for Wasserstein estimators, through the prism of the classical tradeoff between approximation and estimation errors in statistics.…

Machine Learning · Statistics 2024-10-30 Jérémie Bigot , Paul Freulon , Boris P. Hejblum , Arthur Leclaire

Optimal transport is a notoriously difficult problem to solve numerically, with current approaches often remaining intractable for very large scale applications such as those encountered in machine learning. Wasserstein barycenters -- the…

Machine Learning · Computer Science 2021-02-25 Julien Lacombe , Julie Digne , Nicolas Courty , Nicolas Bonneel

Optimal Transport has sparked vivid interest in recent years, in particular thanks to the Wasserstein distance, which provides a geometrically sensible and intuitive way of comparing probability measures. For computational reasons, the…

Machine Learning · Computer Science 2024-03-19 Eloi Tanguy

The use of optimal transport cost for learning generative models has become popular with Wasserstein Generative Adversarial Networks (WGAN). Training of WGAN relies on a theoretical background: the calculation of the gradient of the optimal…

Machine Learning · Statistics 2024-04-04 Antoine Houdard , Arthur Leclaire , Nicolas Papadakis , Julien Rabin

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi

Variational problems that involve Wasserstein distances and more generally optimal transport (OT) theory are playing an increasingly important role in data sciences. Such problems can be used to form an examplar measure out of various…

Machine Learning · Computer Science 2018-11-15 Marco Cuturi , Gabriel Peyré

Controlling the $\mathcal W_\infty$ Wasserstein distance by the $\mathcal W_p$ Wasserstein distance is interesting both for theorical and numerical applications. A first paper on this problem was written several years ago [3]. Some year…

Optimization and Control · Mathematics 2026-01-22 Luigi De Pascale , Igor Pinheiro

We analyze the effect of small changes in the underlying probabilistic model on the value of multi-period stochastic optimization problems and optimal stopping problems. We work in finite discrete time and measure these changes with the…

Optimization and Control · Mathematics 2023-06-19 Daniel Bartl , Johannes Wiesel

We propose a novel end-to-end non-minimax algorithm for training optimal transport mappings for the quadratic cost (Wasserstein-2 distance). The algorithm uses input convex neural networks and a cycle-consistency regularization to…

Machine Learning · Computer Science 2020-12-11 Alexander Korotin , Vage Egiazarian , Arip Asadulaev , Alexander Safin , Evgeny Burnaev

Optimal transport (OT) is a popular tool in machine learning to compare probability measures geometrically, but it comes with substantial computational burden. Linear programming algorithms for computing OT distances scale cubically in the…

Machine Learning · Computer Science 2022-03-24 Gaspard Beugnot , Aude Genevay , Kristjan Greenewald , Justin Solomon