English
Related papers

Related papers: Deriving the Gradients of Some Popular Optimal Tra…

200 papers

Many numerical and learning algorithms rely on the solution of the Monge-Kantorovich problem and Wasserstein distances, which provide appropriate distributional metrics. While the natural approach is to treat the problem as an…

Optimization and Control · Mathematics 2025-12-11 Mohsen Sadr , Peyman Mohajerin Esfahani , Hossein Gorji

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

The optimal transport (OT) problem is a classical optimization problem having the form of linear programming. Machine learning applications put forward new computational challenges in its solution. In particular, the OT problem defines a…

Optimization and Control · Mathematics 2022-10-25 Nazarii Tupitsa , Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov

Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…

Analysis of PDEs · Mathematics 2017-01-10 Guillaume Carlier , Vincent Duval , Gabriel Peyré , Bernhard Schmitzer

This article introduces a new class of fast algorithms to approximate variational problems involving unbalanced optimal transport. While classical optimal transport considers only normalized probability distributions, it is important for…

Optimization and Control · Mathematics 2017-05-23 Lenaic Chizat , Gabriel Peyré , Bernhard Schmitzer , François-Xavier Vialard

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

Applications of optimal transport have recently gained remarkable attention thanks to the computational advantages of entropic regularization. However, in most situations the Sinkhorn approximation of the Wasserstein distance is replaced by…

Machine Learning · Statistics 2019-06-04 Giulia Luise , Alessandro Rudi , Massimiliano Pontil , Carlo Ciliberto

We introduce a new class of convex-regularized Optimal Transport losses, which generalizes the classical Entropy-regularization of Optimal Transport and Sinkhorn divergences, and propose a generalized Sinkhorn algorithm. Our framework…

Optimization and Control · Mathematics 2020-07-03 Simone Di Marino , Augusto Gerolin

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances…

Machine Learning · Statistics 2014-06-18 Marco Cuturi , Arnaud Doucet

This paper addresses the Optimal Transport problem, which is regularized by the square of Euclidean $\ell_2$-norm. It offers theoretical guarantees regarding the iteration complexities of the Sinkhorn--Knopp algorithm, Accelerated Gradient…

Optimization and Control · Mathematics 2023-08-29 Dmitry A. Pasechnyuk , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov

Variational problems that involve Wasserstein distances and more generally optimal transport (OT) theory are playing an increasingly important role in data sciences. Such problems can be used to form an examplar measure out of various…

Machine Learning · Computer Science 2018-11-15 Marco Cuturi , Gabriel Peyré

Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In this work, we focus…

Optimization and Control · Mathematics 2024-03-11 Xun Tang , Holakou Rahmanian , Michael Shavlovsky , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

We consider robust variants of the standard optimal transport, named robust optimal transport, where marginal constraints are relaxed via Kullback-Leibler divergence. We show that Sinkhorn-based algorithms can approximate the optimal cost…

Machine Learning · Computer Science 2021-10-29 Khang Le , Huy Nguyen , Quang Nguyen , Tung Pham , Hung Bui , Nhat Ho

Entropy-regularized optimal transport, which has strong links to the Schr\"odinger bridge problem in statistical mechanics, enjoys a variety of applications from trajectory inference to generative modeling. A major driver of renewed…

Machine Learning · Statistics 2026-01-27 Anand Srinivasan , Jean-Jacques Slotine

This paper introduces a new nonlinear dictionary learning method for histograms in the probability simplex. The method leverages optimal transport theory, in the sense that our aim is to reconstruct histograms using so-called displacement…

Sinkhorn algorithm is the de-facto standard approximation algorithm for optimal transport, which has been applied to a variety of applications, including image processing and natural language processing. In theory, the proof of its…

Data Structures and Algorithms · Computer Science 2025-01-14 Kazuki Watanabe , Noboru Isobe

We introduce fast algorithms for generalized unnormalized optimal transport. To handle densities with different total mass, we consider a dynamic model, which mixes the $L^p$ optimal transport with $L^p$ distance. For $p=1$, we derive the…

Numerical Analysis · Mathematics 2021-04-07 Wonjun Lee , Rongjie Lai , Wuchen Li , Stanley Osher

Entropy regularized optimal transport and its multi-marginal generalization have attracted increasing attention in various applications, in particular due to efficient Sinkhorn-like algorithms for computing optimal transport plans. However,…

Optimization and Control · Mathematics 2023-01-25 Florian Beier , Johannes von Lindheim , Sebastian Neumayer , Gabriele Steidl

Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems are commonly solved…

Machine Learning · Statistics 2025-12-30 O. Deniz Akyildiz , Pierre Del Moral , Joaquín Miguez
‹ Prev 1 2 3 10 Next ›