English
Related papers

Related papers: Interpolating between Optimal Transport and KL reg…

200 papers

Bi-causal optimal transport (OT) is a natural framework for comparing and coupling stochastic processes under nonanticipative information constraints, with important applications in robust finance, sequential uncertainty quantification, and…

Optimization and Control · Mathematics 2026-05-19 Haoyang Cao , Jesse Hoekstra , Renyuan Xu , Yumin Xu , Ruixun Zhang

This paper addresses the problem of Unbalanced Optimal Transport (UOT) in which the marginal conditions are relaxed (using weighted penalties in lieu of equality) and no additional regularization is enforced on the OT plan. In this context,…

Optimization and Control · Mathematics 2021-06-09 Laetitia Chapel , Rémi Flamary , Haoran Wu , Cédric Févotte , Gilles Gasso

This paper addresses a new interpretation of the traditional optimization method in reinforcement learning (RL) as optimization problems using reverse Kullback-Leibler (KL) divergence, and derives a new optimization method using forward KL…

Machine Learning · Computer Science 2022-04-25 Taisuke Kobayashi

In the standard formulation of the denoising problem, one is given a probabilistic model relating a latent variable $\Theta \in \Omega \subset \mathbb{R}^m \; (m\ge 1)$ and an observation $Z \in \mathbb{R}^d$ according to: $Z \mid \Theta…

Statistics Theory · Mathematics 2024-10-01 Nicolas Garcia Trillos , Bodhisattva Sen

Entropic optimal transport -- the optimal transport problem regularized by KL diver\-gence -- is highly successful in statistical applications. Thanks to the smoothness of the entropic coupling, its sample complexity avoids the curse of…

Statistics Theory · Mathematics 2025-05-09 Alberto González-Sanz , Stephan Eckstein , Marcel Nutz

Optimal transport (OT) defines a powerful framework to compare probability distributions in a geometrically faithful way. However, the practical impact of OT is still limited because of its computational burden. We propose a new class of…

Optimization and Control · Mathematics 2016-05-30 Genevay Aude , Marco Cuturi , Gabriel Peyré , Francis Bach

Optimal Transport (OT) theory investigates the cost-minimizing transport map that moves a source distribution to a target distribution. Recently, several approaches have emerged for learning the optimal transport map for a given cost…

Machine Learning · Computer Science 2025-04-01 Jaemoo Choi , Yongxin Chen , Jaewoong Choi

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré

This article details a general numerical framework to approximate so-lutions to linear programs related to optimal transport. The general idea is to introduce an entropic regularization of the initial linear program. This regularized…

Numerical Analysis · Mathematics 2014-12-17 Jean-David Benamou , Guillaume Carlier , Marco Cuturi , Luca Nenna , Gabriel Peyré

Optimal transport (OT) is a versatile framework for comparing probability measures, with many applications to statistics, machine learning, and applied mathematics. However, OT distances suffer from computational and statistical scalability…

Statistics Theory · Mathematics 2022-06-08 Ziv Goldfeld , Kengo Kato , Gabriel Rioux , Ritwik Sadhu

Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with…

Optimization and Control · Mathematics 2026-05-11 Gabriel Peyré

Regularizing the optimal transport (OT) problem has proven crucial for OT theory to impact the field of machine learning. For instance, it is known that regularizing OT problems with entropy leads to faster computations and better…

Machine Learning · Statistics 2020-08-04 François-Pierre Paty , Marco Cuturi

We consider a Beckmann formulation of an unbalanced optimal transport (UOT) problem. The $\Gamma$-convergence of this formulation of UOT to the corresponding optimal transport (OT) problem is established as the balancing parameter $\alpha$…

Numerical Analysis · Mathematics 2023-03-31 Zhe Xiong , Lei Li , Ya-Nan Zhu , Xiaoqun Zhang

This work studies how the introduction of the entropic regularization term in unbalanced Optimal Transport (OT) models may alter their homogeneity with respect to the input measures. We observe that in common settings (including balanced OT…

Optimization and Control · Mathematics 2022-01-07 Théo Lacombe

Optimal transport (OT) measures distances between distributions in a way that depends on the geometry of the sample space. In light of recent advances in computational OT, OT distances are widely used as loss functions in machine learning.…

Methodology · Statistics 2021-06-22 Debarghya Mukherjee , Aritra Guha , Justin Solomon , Yuekai Sun , Mikhail Yurochkin

While the optimal transport (OT) problem was originally formulated as a linear program, the addition of entropic regularization has proven beneficial both computationally and statistically, for many applications. The Sinkhorn fixed-point…

Machine Learning · Statistics 2023-04-06 James Thornton , Marco Cuturi

We study the Unbalanced Optimal Transport (UOT) between two measures of possibly different masses with at most $n$ components, where the marginal constraints of standard Optimal Transport (OT) are relaxed via Kullback-Leibler divergence…

Optimization and Control · Mathematics 2024-01-09 Quang Minh Nguyen , Hoang H. Nguyen , Yi Zhou , Lam M. Nguyen

Optimal Transport (OT) has established itself as a robust framework for quantifying differences between distributions, with applications that span fields such as machine learning, data science, and computer vision. This paper offers a…

Data Structures and Algorithms · Computer Science 2025-01-14 Sina Moradi

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

Machine Learning · Computer Science 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang

This paper improves the state-of-the-art rate of a first-order algorithm for solving entropy regularized optimal transport. The resulting rate for approximating the optimal transport (OT) has been improved from…

Optimization and Control · Mathematics 2023-01-25 Yiling Luo , Yiling Xie , Xiaoming Huo