English
Related papers

Related papers: A Sinkhorn-type Algorithm for Constrained Optimal …

200 papers

Several recent applications of optimal transport (OT) theory to machine learning have relied on regularization, notably entropy and the Sinkhorn algorithm. Because matrix-vector products are pervasive in the Sinkhorn algorithm, several…

Machine Learning · Statistics 2021-03-09 Meyer Scetbon , Marco Cuturi , Gabriel Peyré

Optimal transport induces the Earth Mover's (Wasserstein) distance between probability distributions, a geometric divergence that is relevant to a wide range of problems. Over the last decade, two relaxations of optimal transport have been…

Optimization and Control · Mathematics 2023-01-18 Thibault Séjourné , Jean Feydy , François-Xavier Vialard , Alain Trouvé , Gabriel Peyré

We propose Acc-Sinkhorn, a simple accelerated variant of Sinkhorn for entropy-regularized optimal transport (EOT). The method is derived from a bilevel optimization view: Sinkhorn row scaling solves the inner variable $u$ exactly and…

Optimization and Control · Mathematics 2026-05-29 Zeyi Xu , Long Chen

Computational optimal transport (OT) has recently emerged as a powerful framework with applications in various fields. In this paper we focus on a relaxation of the original OT problem, the entropic OT problem, which allows to implement…

Probability · Mathematics 2025-10-06 Giacomo Greco , Maxence Noble , Giovanni Conforti , Alain Durmus

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

Optimization and Control · Mathematics 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

In this paper, we propose an accelerated version for the Sinkhorn algorithm, which is the reference method for computing the solution to Entropic Optimal Transport. Its main draw-back is the exponential slow-down of convergence as the…

Numerical Analysis · Mathematics 2025-06-19 Reda Chhaibi , Serge Gratton , Samuel Vaiter

Sinkhorn's algorithm is a method of choice to solve large-scale optimal transport (OT) problems. In this context, it involves an inverse temperature parameter $\beta$ that determines the speed-accuracy trade-off. To improve this trade-off,…

Machine Learning · Computer Science 2024-08-22 Lénaïc Chizat

Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes…

Machine Learning · Computer Science 2024-06-21 Gen Li , Yanxi Chen , Yu Huang , Yuejie Chi , H. Vincent Poor , Yuxin Chen

This paper presents consideration of the Semi-Relaxed Sinkhorn (SR-Sinkhorn) algorithm for the semi-relaxed optimal transport (SROT) problem, which relaxes one marginal constraint of the standard OT problem. For evaluation of how the…

Machine Learning · Computer Science 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

This article describes a set of methods for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn--Knopp…

Numerical Analysis · Mathematics 2021-04-02 Alexis Thibault , Lénaïc Chizat , Charles Dossal , Nicolas Papadakis

We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method…

Optimization and Control · Mathematics 2018-02-12 Christoph Brauer , Christian Clason , Dirk Lorenz , Benedikt Wirth

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

Entropic regularization provides a generalization of the original optimal transport problem. It introduces a penalty term defined by the Kullback-Leibler divergence, making the problem more tractable via the celebrated Sinkhorn algorithm.…

Optimization and Control · Mathematics 2023-01-04 Dávid Terjék , Diego González-Sánchez

In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we…

Data Structures and Algorithms · Computer Science 2023-04-06 Jingbang Chen , Li Chen , Yang P. Liu , Richard Peng , Arvind Ramaswami

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

Machine Learning · Computer Science 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

We introduce in this paper a novel strategy for efficiently approximating the Sinkhorn distance between two discrete measures. After identifying neglectable components of the dual solution of the regularized Sinkhorn problem, we propose to…

Machine Learning · Statistics 2020-01-22 Mokhtar Z. Alaya , Maxime Bérar , Gilles Gasso , Alain Rakotomamonjy

Computing the optimal transport distance between statistical distributions is a fundamental task in machine learning. One remarkable recent advancement is entropic regularization and the Sinkhorn algorithm, which utilizes only matrix…

Optimization and Control · Mathematics 2024-01-24 Xun Tang , Michael Shavlovsky , Holakou Rahmanian , Elisa Tardini , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

Ensuring fairness in matching algorithms is a key challenge in allocating scarce resources and positions. Focusing on Optimal Transport (OT), we introduce a novel notion of group fairness requiring that the probability of matching two…

Machine Learning · Statistics 2026-02-02 Linus Bleistein , Mathieu Dagréou , Francisco Andrade , Thomas Boudou , Aurélien Bellet