English
Related papers

Related papers: Interpolating between Optimal Transport and KL reg…

200 papers

Ensuring fairness in matching algorithms is a key challenge in allocating scarce resources and positions. Focusing on Optimal Transport (OT), we introduce a novel notion of group fairness requiring that the probability of matching two…

Machine Learning · Statistics 2026-02-02 Linus Bleistein , Mathieu Dagréou , Francisco Andrade , Thomas Boudou , Aurélien Bellet

Given a $d$-dimensional continuous (resp. discrete) probability distribution $\mu$ and a discrete distribution $\nu$, the semi-discrete (resp. discrete) Optimal Transport (OT) problem asks for computing a minimum-cost plan to transport mass…

Computational Geometry · Computer Science 2023-11-07 Pankaj K. Agarwal , Sharath Raghvendra , Pouyan Shirzadian , Keegan Yao

Unbalanced optimal transport (UOT) is a natural extension of optimal transport (OT) allowing comparison between measures of different masses. It arises naturally in machine learning by offering a robustness against outliers. The aim of this…

Optimization and Control · Mathematics 2025-10-06 Luca Nenna , Paul Pegon , Louis Tocquec

Optimal transport (OT) is a general framework for finding a minimum-cost transport plan, or coupling, between probability distributions, and has many applications in machine learning. A key challenge in applying OT to massive datasets is…

Machine Learning · Computer Science 2024-11-19 Peter Halmos , Xinhao Liu , Julian Gold , Benjamin J Raphael

The Unbalanced Optimal Transport (UOT) problem plays increasingly important roles in computational biology, computational imaging and deep learning. Scaling algorithm is widely used to solve UOT due to its convenience and good convergence…

Optimization and Control · Mathematics 2024-02-28 Xiang Chen , Faqiang Wang , Jun Liu , Li Cui

Adding entropic regularization to Optimal Transport (OT) problems has become a standard approach for designing efficient and scalable solvers. However, regularization introduces a bias from the true solution. To mitigate this bias while…

This article describes a set of methods for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn--Knopp…

Numerical Analysis · Mathematics 2021-04-02 Alexis Thibault , Lénaïc Chizat , Charles Dossal , Nicolas Papadakis

Optimal Transport (OT) is a mathematical framework that first emerged in the eighteenth century and has led to a plethora of methods for answering many theoretical and applied questions. The last decade has been a witness to the remarkable…

Machine Learning · Computer Science 2024-03-25 Abdelwahed Khamis , Russell Tsuchida , Mohamed Tarek , Vivien Rolland , Lars Petersson

In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we…

Data Structures and Algorithms · Computer Science 2023-04-06 Jingbang Chen , Li Chen , Yang P. Liu , Richard Peng , Arvind Ramaswami

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

Optimal transport (OT) has become exceedingly popular in machine learning, data science, and computer vision. The core assumption in the OT problem is the equal total amount of mass in source and target measures, which limits its…

Machine Learning · Computer Science 2023-08-08 Yikun Bai , Berhnard Schmitzer , Mathew Thorpe , Soheil Kolouri

In this paper, we present a numerical method, based on iterative Bregman projections, to solve the optimal transport problem with Coulomb cost. This is related to the strong interaction limit of Density Functional Theory. The first idea is…

Numerical Analysis · Mathematics 2015-05-11 Jean-David Benamou , Guillaume Carlier , Luca Nenna

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a…

Machine Learning · Computer Science 2024-03-08 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Reverse Kullback-Leibler (KL) divergence-based regularization with respect to a fixed reference policy is widely used in modern reinforcement learning to preserve the desired traits of the reference policy and sometimes to promote…

Machine Learning · Computer Science 2026-02-05 Anupam Nayak , Tong Yang , Osman Yagan , Gauri Joshi , Yuejie Chi

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

Numerical Analysis · Mathematics 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

A weighted, semi-discrete, fast optimal transport (OT) algorithm for reconstructing the Lagrangian positions of proto-halos from their evolved Eulerian positions is presented. The algorithm makes use of a mass estimate of the biased tracers…

Cosmology and Nongalactic Astrophysics · Physics 2023-01-10 Farnik Nikakhtar , Ravi K. Sheth , Bruno Lévy , Roya Mohayaee

In this note, we derive upper-bounds on the statistical estimation rates of unbalanced optimal transport (UOT) maps for the quadratic cost. Our work relies on the stability of the semi-dual formulation of optimal transport (OT) extended to…

Statistics Theory · Mathematics 2022-03-18 Adrien Vacher , François-Xavier Vialard

\emph{Kullback-Leibler} (KL) regularization is ubiquitous in reinforcement learning algorithms in the form of \emph{reverse} or \emph{forward} KL. Recent studies have demonstrated $\epsilon^{-1}$-type fast rates for decision making under…

Machine Learning · Computer Science 2026-05-12 Qingyue Zhao , Kaixuan Ji , Heyang Zhao , Quanquan Gu

The Optimal transport (OT) problem is rapidly finding its way into machine learning. Favoring its use are its metric properties. Many problems admit solutions with guarantees only for objects embedded in metric spaces, and the use of…

Machine Learning · Computer Science 2022-12-26 Liang Mi , Azadeh Sheikholeslami , José Bento