English
Related papers

Related papers: Closed Forms for Gaussian Kullback--Leibler Unbala…

200 papers

We introduce a stochastic approximation method for the solution of an ergodic Kullback-Leibler control problem. A Kullback-Leibler control problem is a Markov decision process on a finite state space in which the control cost is…

Optimization and Control · Mathematics 2012-02-17 Joris Bierkens , Bert Kappen

We establish several quantitative stability estimates for optimal transport maps between non-degenerate densities on uniformly convex domains for the quadratic cost. Under H\"older regularity assumptions, we prove Lipschitz $L^2$…

Analysis of PDEs · Mathematics 2026-05-26 F. -U. Caja-Lopez , Matias G. Delgadino , Jun Kitagawa

We examine the estimation of the Kullback-Leibler (KL) divergence and the use of the goodness-of-fit test for multivariate continuous distributions. Our starting point is the maximum entropy principle for Shannon entropy: among all…

Statistics Theory · Mathematics 2026-03-10 Mehmet Siddik Cadirci , Martin Singull

This short note is on a property of the Kullback-Leibler (KL) divergence which indicates that independent Gaussian distributions minimize the KL divergence from given independent Gaussian distributions. The primary purpose of this note is…

Information Theory · Computer Science 2020-12-04 Song Fang , Quanyan Zhu

The function that maps a family of probability measures to the solution of the dual entropic optimal transport problem is known as the Schr\"odinger map. We prove that when the cost function is $\mathcal{C}^{k+1}$ with $k\in \mathbb{N}^*$…

Optimization and Control · Mathematics 2024-03-04 Guillaume Carlier , Lénaïc Chizat , Maxime Laborde

In this work, we construct a novel numerical method for solving the multi-marginal optimal transport problems with Coulomb cost. This type of optimal transport problems arises in quantum physics and plays an important role in understanding…

Optimization and Control · Mathematics 2023-06-16 Yukuan Hu , Huajie Chen , Xin Liu

We study the Unbalanced Optimal Transport (UOT) between two measures of possibly different masses with at most $n$ components, where the marginal constraints of standard Optimal Transport (OT) are relaxed via Kullback-Leibler divergence…

Optimization and Control · Mathematics 2024-01-09 Quang Minh Nguyen , Hoang H. Nguyen , Yi Zhou , Lam M. Nguyen

We prove discrete-to-continuum convergence for dynamical optimal transport on $\mathbb{Z}^d$-periodic graphs with energy density having linear growth at infinity. This result provides an answer to a problem left open by Gladbach, Kopfer,…

Optimization and Control · Mathematics 2026-05-20 Lorenzo Portinale , Filippo Quattrocchi

We consider optimal transport problems where the cost is optimized over controlled dynamics and the end time is free. Unlike the classical setting, the search for optimal transport plans also requires the identification of optimal "stopping…

Optimization and Control · Mathematics 2018-07-09 Nassif Ghoussoub , Young-Heon Kim , Aaron Zeff Palmer

Finding the proper entropy-like Lyapunov functional associated with the inelastic Boltzmann equation for an isolated freely cooling granular gas is a still unsolved challenge. The original $H$-theorem hypotheses do not fit here and the…

Soft Condensed Matter · Physics 2020-11-19 Alberto Megías , Andrés Santos

The quadratically regularized optimal transport problem has recently been considered in various applications where the coupling needs to be \emph{sparse}, i.e., the density of the coupling needs to be zero for a large subset of the product…

Analysis of PDEs · Mathematics 2024-08-01 Alejandro Garriz-Molina , Alberto González-Sanz , Gilles Mordant

We study the problem of selection of regularization parameter in penalized Gaussian graphical models. When the goal is to obtain the model with good predicting power, cross validation is the gold standard. We present a new estimator of…

Methodology · Statistics 2014-03-06 Ivan Vujacic , Antonino Abbruzzo , Ernst Wit

It was recently shown that under smoothness conditions, the squared Wasserstein distance between two distributions could be efficiently computed with appealing statistical error upper bounds. However, rather than the distance itself, the…

Machine Learning · Statistics 2021-12-30 Boris Muzellec , Adrien Vacher , Francis Bach , François-Xavier Vialard , Alessandro Rudi

We completely characterise the optimal solutions for the three-marginal optimal transport problem - introduced in [K. Bolbotowski, G. Bouchitt\'e, Kantorovich-Rubinstein duality theory for the Hessian, 2024, preprint], and whose relaxation…

Optimization and Control · Mathematics 2025-02-14 Krzysztof J. Ciosmak

We study an entropic optimal transport problem in which the transport plan is penalized by a nonlinear convex functional acting on the coupling. We establish existence, uniqueness, and uniform a priori bounds for minimizers, and we show…

Optimization and Control · Mathematics 2025-12-15 Anna Kazeykina , Zhenjie Ren , Xiaozhen Wang , Yufei Zhang

Replacing the quadratic proximal penalty familiar from Hilbert spaces by an unbalanced optimal transport distance, we develop forward-backward type optimisation methods in spaces of Radon measures. We avoid the actual computation of the…

Optimization and Control · Mathematics 2025-02-19 Tuomo Valkonen

The relevance of optimal transport methods to machine learning has long been hindered by two salient limitations. First, the $O(n^3)$ computational cost of standard sample-based solvers (when used on batches of $n$ samples) is prohibitive.…

Machine Learning · Computer Science 2023-06-01 Meyer Scetbon , Michal Klein , Giovanni Palla , Marco Cuturi

Kullback Leibler (KL) control problems allow for efficient computation of optimal control by solving a principal eigenvector problem. However, direct applicability of such framework to continuous state-action systems is limited. In this…

Systems and Control · Computer Science 2014-08-28 Takamitsu Matsubara , Vicenç Gómez , Hilbert J. Kappen

We study the Optimal Transport problem for laws of random measures in the Kantorovich-Wasserstein space $\mathcal{P}_2(\mathcal{P}_2(\mathrm{H}))$, associated with a Hilbert space $\mathrm{H}$ (with finite or infinite dimension) and for the…

Functional Analysis · Mathematics 2025-09-03 Alessandro Pinzi , Giuseppe Savaré

The fundamental theorem of classical optimal transport establishes strong duality and characterizes optimizers through a complementary slackness condition. Milestones such as Brenier's theorem and the Kantorovich-Rubinstein formula are…

Probability · Mathematics 2025-01-28 Mathias Beiglböck , Gudmund Pammer , Lorenz Riess , Stefan Schrott