English
Related papers

Related papers: Optimal Transport losses and Sinkhorn algorithm wi…

200 papers

We study distributionally robust optimization with Sinkhorn distance -- a variant of Wasserstein distance based on entropic regularization. We derive a convex programming dual reformulation for general nominal distributions, transport…

Optimization and Control · Mathematics 2025-03-27 Jie Wang , Rui Gao , Yao Xie

The optimal mass transport problem gives a geometric framework for optimal allocation, and has recently gained significant interest in application areas such as signal processing, image processing, and computer vision. Even though it can be…

Optimization and Control · Mathematics 2018-02-07 Johan Karlsson , Axel Ringh

We study the stability of entropically regularized optimal transport with respect to the marginals. Lipschitz continuity of the value and H\"older continuity of the optimal coupling in $p$-Wasserstein distance are obtained under general…

Optimization and Control · Mathematics 2022-07-06 Stephan Eckstein , Marcel Nutz

This paper addresses the Optimal Transport problem, which is regularized by the square of Euclidean $\ell_2$-norm. It offers theoretical guarantees regarding the iteration complexities of the Sinkhorn--Knopp algorithm, Accelerated Gradient…

Optimization and Control · Mathematics 2023-08-29 Dmitry A. Pasechnyuk , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

Regularizing the optimal transport (OT) problem has proven crucial for OT theory to impact the field of machine learning. For instance, it is known that regularizing OT problems with entropy leads to faster computations and better…

Machine Learning · Statistics 2020-08-04 François-Pierre Paty , Marco Cuturi

In this paper, we propose the optimal production transport model, which is an extension of the classical optimal transport model. We observe in economics, the production of the factories can always be adjusted within a certain range, while…

Optimization and Control · Mathematics 2025-07-02 Jie Fan , Tianhao Wu , Hao Wu

In this work we propose a batch version of the Greenkhorn algorithm for multimarginal regularized optimal transport problems. Our framework is general enough to cover, as particular cases, some existing algorithms like Sinkhorn and…

Machine Learning · Statistics 2021-12-07 Vladimir Kostic , Saverio Salzo , Massimilano Pontil

Recently, linear regression models incorporating an optimal transport (OT) loss have been explored for applications such as supervised unmixing of spectra, music transcription, and mass spectrometry. However, these task-specific approaches…

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

Optimization and Control · Mathematics 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang

This chapter describes techniques for the numerical resolution of optimal transport problems. We will consider several discretizations of these problems, and we will put a strong focus on the mathematical analysis of the algorithms to solve…

Numerical Analysis · Mathematics 2020-03-03 Quentin Merigot , Boris Thibert

We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method…

Optimization and Control · Mathematics 2018-02-12 Christoph Brauer , Christian Clason , Dirk Lorenz , Benedikt Wirth

We study Sinkhorn's algorithm for solving the entropically regularized optimal transport problem. Its iterate $\pi_{t}$ is shown to satisfy $H(\pi_{t}|\pi_{*})+H(\pi_{*}|\pi_{t})=O(t^{-1})$ where $H$ denotes relative entropy and $\pi_{*}$…

Optimization and Control · Mathematics 2025-04-08 Promit Ghosal , Marcel Nutz

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

This article studies problems of optimal transport, by embedding them in a general functional analytic framework of convex optimization. This provides a unified treatment of a large class of related problems in probability theory and allows…

Probability · Mathematics 2017-10-31 Teemu Pennanen , Ari-Pekka Perkkiö

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

The Sinkhorn algorithm is a widely used method for solving the optimal transport problem, and the Greenkhorn algorithm is one of its variants. While there are modified versions of these two algorithms whose computational complexities are…

Optimization and Control · Mathematics 2023-10-20 Jianzhou Luo , Dingchuan Yang , Ke Wei

An optimal transport (OT) problem seeks to find the cheapest mapping between two distributions with equal total density, given the cost of transporting density from one place to another. Unbalanced OT allows for different total density in…

Optimization and Control · Mathematics 2025-07-28 Jacob J. M. Francis , Colin J. Cotter , Marion P. Mittermaier