English
Related papers

Related papers: Statistical bounds for entropic optimal transport:…

200 papers

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

Information Theory · Computer Science 2018-12-11 Igal Sason

In this article, we study unbalanced optimal transport (UOT) and establish a control-theoretic dynamical extension, which we call the unbalanced density control (UDC), for a class of Gaussian reference measures. In the static setting, we…

Optimization and Control · Mathematics 2026-05-07 Haruto Nakashima , Siddhartha Ganguly , Kenji Kashima

We present a new approach, inspired by Stein's method, to prove a central limit theorem (CLT) for linear statistics of $\beta$-ensembles in the one-cut regime. Compared with the previous proofs, our result requires less regularity on the…

Probability · Mathematics 2019-02-20 Gaultier Lambert , Michel Ledoux , Christian Webb

We study optimal transport between two high-dimensional distributions $\mu,\nu$ in $R^n$ from an algorithmic perspective: given $x \sim \mu$, find a close $y \sim \nu$ in $poly(n)$ time, where $n$ is the dimension of $x,y$. Thus, running…

Data Structures and Algorithms · Computer Science 2025-09-29 Salman Beigi , Omid Etesami , Mohammad Mahmoody , Amir Najafi

We characterize the solution to the entropically regularized optimal transport problem by a well-posed ordinary differential equation (ODE). Our approach works for discrete marginals and general cost functions, and in addition to two…

Optimization and Control · Mathematics 2024-04-01 Joshua Zoen-Git Hiew , Luca Nenna , Brendan Pass

Multimarginal optimal transport (MOT) has emerged as a useful framework for many applied problems. However, compared to the well-studied classical two-marginal optimal transport theory, analysis of MOT is far more challenging and remains…

Statistics Theory · Mathematics 2026-01-01 Pengtao Li , Xiaohui Chen

We study the entropic regularizations of optimal transport problems under suitable summability assumptions on the point-wise transport cost. These summability assumptions already appear in the literature. However, we show that the weakest…

Optimization and Control · Mathematics 2025-12-30 Camilla Brizzi , Luigi De Pascale , Anna Kausamo

We study the quadratically regularized optimal transport (QOT) problem for quadratic cost and compactly supported marginals $\mu$ and $\nu$. It has been empirically observed that the optimal coupling $\pi_\epsilon$ for the QOT problem has…

Optimization and Control · Mathematics 2024-10-07 Johannes Wiesel , Xingyu Xu

Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a lower bound to language compression. The most efficient…

Computation and Language · Computer Science 2025-11-14 Benjamin L. Badger , Matthew Neligeorge

We analyze optimal transport problems with additional entropic cost evaluated along curves in the Wasserstein space which join two probability measures $m_0,m_1$. The effect of the additional entropy functional results into an elliptic…

Analysis of PDEs · Mathematics 2022-11-18 Alessio Porretta

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

Learning conditional distributions $\pi^*(\cdot|x)$ is a central problem in machine learning, which is typically approached via supervised methods with paired data $(x,y) \sim \pi^*$. However, acquiring paired data samples is often…

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential…

Information Theory · Computer Science 2022-11-23 Arda Atalik , Alper Köse , Michael Gastpar

Motivated by the entropy computations relevant to the evaluation of decrease in entropy in bit reset operations, the authors investigate the deficit in an entropic inequality involving two independent random variables, one continuous and…

Information Theory · Computer Science 2018-09-21 James Melbourne , Saurav Talukdar , Shreyas Bhaban , Murti V. Salapaka

We study the maximum achievable differential entropy at the output of a system assigning to each input X the sum X+N, with N a given noise with probability law absolutely continuous with respect to the Lebesgue measure and where the input…

Optimization and Control · Mathematics 2016-02-04 Francisco J. Piera

Optimal transport (OT) theory provides powerful tools to compare probability measures. However, OT is limited to nonnegative measures having the same mass, and suffers serious drawbacks about its computation and statistics. This leads to…

Machine Learning · Statistics 2021-01-26 Tam Le , Truyen Nguyen

We present an efficient algorithm to compute tight upper bounds of collision probability between two objects with positional uncertainties, whose error distributions are represented with non-Gaussian forms. Our approach can handle noisy…

Robotics · Computer Science 2019-12-17 Jae Sung Park , Dinesh Manocha

We study the small-regularisation limit of the entropic optimal transport problem on the line with distance cost. While convergence of entropic minimizers is well understood in the discrete setting and in the case where the cost is…

Optimization and Control · Mathematics 2025-12-08 Armand Ley

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

We propose a novel neural algorithm for the fundamental problem of computing the entropic optimal transport (EOT) plan between continuous probability distributions which are accessible by samples. Our algorithm is based on the saddle point…

Machine Learning · Computer Science 2023-11-02 Nikita Gushchin , Alexander Kolesov , Alexander Korotin , Dmitry Vetrov , Evgeny Burnaev