English
Related papers

Related papers: Overrelaxed Sinkhorn-Knopp Algorithm for Regulariz…

200 papers

Sinkhorn's algorithm is a method of choice to solve large-scale optimal transport (OT) problems. In this context, it involves an inverse temperature parameter $\beta$ that determines the speed-accuracy trade-off. To improve this trade-off,…

Machine Learning · Computer Science 2024-08-22 Lénaïc Chizat

The Sinkhorn--Knopp (SK) algorithm is a cornerstone method for matrix scaling and entropically regularized optimal transport (EOT). Despite its empirical efficiency, existing theoretical guarantees to achieve a target marginal accuracy…

Data Structures and Algorithms · Computer Science 2026-04-07 Kun He

Computing the optimal transport distance between statistical distributions is a fundamental task in machine learning. One remarkable recent advancement is entropic regularization and the Sinkhorn algorithm, which utilizes only matrix…

Optimization and Control · Mathematics 2024-01-24 Xun Tang , Michael Shavlovsky , Holakou Rahmanian , Elisa Tardini , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

Machine Learning · Statistics 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

Machine Learning · Computer Science 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

We consider the fundamental problem of sampling the optimal transport coupling between given source and target distributions. In certain cases, the optimal transport plan takes the form of a one-to-one mapping from the source support to the…

Machine Learning · Computer Science 2025-10-28 Mara Daniels , Tyler Maunu , Paul Hand

We study Sinkhorn's algorithm for solving the entropically regularized optimal transport problem. Its iterate $\pi_{t}$ is shown to satisfy $H(\pi_{t}|\pi_{*})+H(\pi_{*}|\pi_{t})=O(t^{-1})$ where $H$ denotes relative entropy and $\pi_{*}$…

Optimization and Control · Mathematics 2025-04-08 Promit Ghosal , Marcel Nutz

In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we…

Data Structures and Algorithms · Computer Science 2023-04-06 Jingbang Chen , Li Chen , Yang P. Liu , Richard Peng , Arvind Ramaswami

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimizing general convex…

Machine Learning · Computer Science 2023-06-21 Marin Ballu , Quentin Berthet

Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic…

Numerical Analysis · Mathematics 2018-03-06 Jean-David Benamou , Guillaume Carlier , Luca Nenna

Optimal Transport is a popular distance metric for measuring similarity between distributions. Exact algorithms for computing Optimal Transport can be slow, which has motivated the development of approximate numerical solvers (e.g. Sinkhorn…

Machine Learning · Computer Science 2022-03-09 Nathaniel Lahn , Sharath Raghvendra , Kaiyi Zhang

We develop a general approach to prove global regularity estimates for quadratic optimal transport using the entropic regularisation of the problem and the Prekopa-Leindler inequality.

Functional Analysis · Mathematics 2025-12-04 Nathael Gozlan , Maxime Sylvestre

We provide a computational complexity analysis for the Sinkhorn algorithm that solves the entropic regularized Unbalanced Optimal Transport (UOT) problem between two measures of possibly different masses with at most $n$ components. We show…

Computational Complexity · Computer Science 2020-11-20 Khiem Pham , Khang Le , Nhat Ho , Tung Pham , Hung Bui

We consider the optimal control problem of steering an agent population to a desired distribution over an infinite horizon. This is an optimal transport problem over dynamical systems, which is challenging due to its high computational…

Optimization and Control · Mathematics 2023-01-18 Kaito Ito , Kenji Kashima

Adapted optimal transport (AOT) problems are optimal transport problems for distributions of a time series where couplings are constrained to have a temporal causal structure. In this paper, we develop computational tools for solving AOT…

Probability · Mathematics 2023-04-26 Stephan Eckstein , Gudmund Pammer

The Unbalanced Optimal Transport (UOT) problem plays increasingly important roles in computational biology, computational imaging and deep learning. Scaling algorithm is widely used to solve UOT due to its convenience and good convergence…

Optimization and Control · Mathematics 2024-02-28 Xiang Chen , Faqiang Wang , Jun Liu , Li Cui

We propose Regularized Overestimated Newton (RON), a Newton-type method with low per-iteration cost and strong global and local convergence guarantees for smooth convex optimization. RON interpolates between gradient descent and globally…

Optimization and Control · Mathematics 2025-10-02 Danny Duan , Hanbaek Lyu

We study a general convex optimization problem, which covers various classic problems in different areas and particularly includes many optimal transport related problems arising in recent years. To solve this problem, we revisit the…

Optimization and Control · Mathematics 2022-05-18 Lei Yang , Kim-Chuan Toh