English
Related papers

Related papers: Closed Forms for Gaussian Kullback--Leibler Unbala…

200 papers

Optimal transport (OT) and Gromov-Wasserstein (GW) alignment provide interpretable geometric frameworks for comparing, transforming, and aggregating heterogeneous datasets -- tasks ubiquitous in data science and machine learning. Because…

Machine Learning · Computer Science 2025-12-04 Sanjit Dandapanthula , Aleksandr Podkopaev , Shiva Prasad Kasiviswanathan , Aaditya Ramdas , Ziv Goldfeld

Kullback-Leibler divergence (KL) regularization is widely used in reinforcement learning, but it becomes infinite under support mismatch and can degenerate in low-noise limits. Utilizing a unified information-geometric framework, we…

Optimization and Control · Mathematics 2026-02-03 Viktor Stein , Adwait Datar , Nihat Ay

A quadratic optimal transport metric on the set of probability measure over $\R^2$ is introduced. The quadratic cost is given by the euclidean norm on $\R^2$ associated to some well chosen symmetric positive matrix, which makes the metric…

Analysis of PDEs · Mathematics 2021-02-23 Samir Salem

The Kullback-Leibler (KL) divergence is not a proper distance metric and does not satisfy the triangle inequality, posing theoretical challenges in certain practical applications. Existing work has demonstrated that KL divergence between…

Machine Learning · Statistics 2026-03-03 Shiji Xiao , Yufeng Zhang , Chubo Liu , Yan Ding , Keqin Li , Kenli Li

The Optimal Transport (OT) problem with squared Euclidean cost consists in finding a coupling between two input measures that maximizes correlation. Consequently, the optimal coupling is often singular with respect to the Lebesgue measure.…

Statistics Theory · Mathematics 2026-04-10 Paul Freulon , Nikitas Georgakis , Victor Panaretos

Although optimal transport (OT) problems admit closed form solutions in a very few notable cases, e.g. in 1D or between Gaussians, these closed forms have proved extremely fecund for practitioners to define tools inspired from the OT…

Statistics Theory · Mathematics 2020-12-15 Hicham Janati , Boris Muzellec , Gabriel Peyré , Marco Cuturi

In its most general form, the optimal transport problem is an infinite-dimensional optimization problem, yet certain notable instances admit closed-form solutions. We identify the common source of this tractability as \textit{symmetry} and…

Optimization and Control · Mathematics 2026-05-22 Bahar Taskesen

We present a functional calculus treatment of Entropic Optimal Transport (EOT) between Gaussian measures on separable Hilbert spaces, providing a unified framework that handles infinite-dimensional degeneracy. By leveraging the notion of…

Optimization and Control · Mathematics 2026-05-27 Ho Yun

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

Entropic optimal transport -- the optimal transport problem regularized by KL diver\-gence -- is highly successful in statistical applications. Thanks to the smoothness of the entropic coupling, its sample complexity avoids the curse of…

Statistics Theory · Mathematics 2025-05-09 Alberto González-Sanz , Stephan Eckstein , Marcel Nutz

We analyze controlled mass transportation plans with free end-time that minimize the transport cost induced by the generating function of a Lagrangian within a bounded domain, in addition to costs incurred as export and import tariffs at…

Analysis of PDEs · Mathematics 2019-03-07 Samer Dweik , Nassif Ghoussoub , Aaron Zeff Palmer

We discuss a relation between the Kantorovich-Wasserstein (KW) metric and the Kullback-Leibler (KL) divergence. The former is defined using the optimal transport problem (OTP) in the Kantorovich formulation. The latter is used to define…

Information Theory · Computer Science 2019-08-27 Roman V. Belavkin

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel

Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks. Since the Kullback-Leibler divergence of mixtures provably…

Machine Learning · Computer Science 2017-02-01 Frank Nielsen , Ke Sun

This paper investigates the best known bounds on the quadratic Gaussian distortion-rate-perception function with limited common randomness for the Kullback-Leibler divergence-based perception measure, as well as their counterparts for the…

Information Theory · Computer Science 2024-09-05 Li Xie , Liangyan Li , Jun Chen , Lei Yu , Zhongshan Zhang

We consider the problem of optimal transportation with quadratic cost between a empirical measure and a general target probability on R d , with d $\ge$ 1. We provide new results on the uniqueness and stability of the associated optimal…

Probability · Mathematics 2018-03-12 Eustasio Del Barrio , Jean-Michel Loubes

Derivative based optimization methods are efficient at solving optimal control problems near local optima. However, their ability to converge halts when derivative information vanishes. The inference approach to optimal control does not…

Robotics · Computer Science 2022-03-01 Daniel Layeghi , Steve Tonneau , Michael Mistry

This paper addresses the Optimal Transport problem, which is regularized by the square of Euclidean $\ell_2$-norm. It offers theoretical guarantees regarding the iteration complexities of the Sinkhorn--Knopp algorithm, Accelerated Gradient…

Optimization and Control · Mathematics 2023-08-29 Dmitry A. Pasechnyuk , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov

We study the convergence of divergence-regularized optimal transport as the regularization parameter vanishes. Sharp rates for general divergences including relative entropy or $L^{p}$ regularization, general transport costs and…

Optimization and Control · Mathematics 2023-06-22 Stephan Eckstein , Marcel Nutz

We analyze optimal transport problems with additional entropic cost evaluated along curves in the Wasserstein space which join two probability measures $m_0,m_1$. The effect of the additional entropy functional results into an elliptic…

Analysis of PDEs · Mathematics 2022-11-18 Alessio Porretta