English
Related papers

Related papers: Accelerating Sinkhorn for Entropy-Regularized Opti…

200 papers

This work studies how the introduction of the entropic regularization term in unbalanced Optimal Transport (OT) models may alter their homogeneity with respect to the input measures. We observe that in common settings (including balanced OT…

Optimization and Control · Mathematics 2022-01-07 Théo Lacombe

We study the Unbalanced Optimal Transport (UOT) between two measures of possibly different masses with at most $n$ components, where the marginal constraints of standard Optimal Transport (OT) are relaxed via Kullback-Leibler divergence…

Optimization and Control · Mathematics 2024-01-09 Quang Minh Nguyen , Hoang H. Nguyen , Yi Zhou , Lam M. Nguyen

In this work, we aim at efficiently solving a parametrized family of optimal transport problems by using model order reduction methods. We propose a reduced-order model by adding to the primal (respectively dual) version of the…

Numerical Analysis · Mathematics 2026-04-13 Elise Bonnet-Weill , Virginie Ehrlacher , Luca Nenna

Many problems in machine learning can be formulated as solving entropy-regularized optimal transport on the space of probability measures. The canonical approach involves the Sinkhorn iterates, renowned for their rich mathematical…

Machine Learning · Computer Science 2023-11-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Andreas Krause

We develop a generalization of Nesterov's accelerated gradient descent method which is designed to deal with orthogonality constraints. To demonstrate the effectiveness of our method, we perform numerical experiments which demonstrate that…

Optimization and Control · Mathematics 2021-01-07 Jonathan W. Siegel

While the continuous Entropic Optimal Transport (EOT) field has been actively developing in recent years, it became evident that the classic EOT problem is prone to different issues like the sensitivity to outliers and imbalance of classes…

Machine Learning · Computer Science 2025-02-04 Milena Gazdieva , Arip Asadulaev , Alexander Korotin , Evgeny Burnaev

Optimal transport is a machine learning problem with applications including distribution comparison, feature selection, and generative adversarial networks. In this paper, we propose feature-robust optimal transport (FROT) for…

Although optimal transport (OT) problems admit closed form solutions in a very few notable cases, e.g. in 1D or between Gaussians, these closed forms have proved extremely fecund for practitioners to define tools inspired from the OT…

Statistics Theory · Mathematics 2020-12-15 Hicham Janati , Boris Muzellec , Gabriel Peyré , Marco Cuturi

Classical entropy regularization is poorly suited to continuous-time martingale transport, since relative entropy between diffusion laws typically forces their volatility characteristics to coincide. We introduce a specific-entropy…

Probability · Mathematics 2026-05-22 Francois Buet-Golfouse , Anaïs Després , Zhenjie Ren , Xin Zhang

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

In a Hilbert framework, for convex differentiable optimization, we consider accelerated gradient methods obtained by combining temporal scaling and averaging techniques with Tikhonov regularization. We start from the continuous steepest…

Optimization and Control · Mathematics 2022-11-21 Hedy Attouch , Zaki Chbani , Hassan Riahi

We study the vanishing-regularization limit of entropically regularized optimal transport (EOT) for the Euclidean distance cost $c(x,y)=\|x-y\|$ in dimension $d>1$. We develop a comprehensive variational convergence framework that entails…

Optimization and Control · Mathematics 2026-04-29 Marcel Nutz , Chenyang Zhong

We study the stability of entropically regularized optimal transport with respect to the marginals. Lipschitz continuity of the value and H\"older continuity of the optimal coupling in $p$-Wasserstein distance are obtained under general…

Optimization and Control · Mathematics 2022-07-06 Stephan Eckstein , Marcel Nutz

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being…

Biomolecules · Quantitative Biology 2022-10-19 A. Tajmir Riahi , G. Woollard , F. Poitevin , A. Condon , K. Dao Duc

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

In this paper, we propose a new framework named Communication Optimal Transport (CommOT) for computing the rate distortion (RD) function. This work is motivated by observing the fact that the transition law and the relative entropy in…

Information Theory · Computer Science 2022-12-21 Shitong Wu , Wenhao Ye , Hao Wu , Huihui Wu , Wenyi Zhang , Bo Bai

The JKO scheme is a time-discrete scheme of implicit Euler type that allows to construct weak solutions of evolution PDEs which have a Wasserstein gradient structure. The purpose of this work is to study the effect of replacing the…

Analysis of PDEs · Mathematics 2025-02-19 Aymeric Baradat , Anastasiia Hraivoronska , Filippo Santambrogio

We provide improved convergence rates for various \emph{non-smooth} optimization problems via higher-order accelerated methods. In the case of $\ell_\infty$ regression, we achieves an $O(\epsilon^{-4/5})$ iteration complexity, breaking the…

Optimization and Control · Mathematics 2019-06-05 Brian Bullins , Richard Peng

We show that the discrete Sinkhorn algorithm - as applied in the setting of Optimal Transport on a compact manifold - converges to the solution of a fully non-linear parabolic PDE of Monge-Ampere type, in a large-scale limit. The latter…

Analysis of PDEs · Mathematics 2020-06-29 Robert J. Berman

Partial identification often arises when the joint distribution of the data is known only up to its marginals. We consider the corresponding partially identified GMM model and develop a methodology for identification, estimation, and…

Econometrics · Economics 2025-12-29 Grigory Franguridi , Laura Liu