English
Related papers

Related papers: Accelerating Sinkhorn for Entropy-Regularized Opti…

200 papers

Entropic Optimal Transport (EOT), also referred to as the Schr\"odinger problem, seeks to find a random processes with prescribed initial/final marginals and with minimal relative entropy with respect to a reference measure. The relative…

Optimization and Control · Mathematics 2024-12-17 Jean-David Benamou , Guillaume Chazareix , Marc Hoffmann , Grégoire Loeper , François-Xavier Vialard

We study an entropic optimal transport problem in which the transport plan is penalized by a nonlinear convex functional acting on the coupling. We establish existence, uniqueness, and uniform a priori bounds for minimizers, and we show…

Optimization and Control · Mathematics 2025-12-15 Anna Kazeykina , Zhenjie Ren , Xiaozhen Wang , Yufei Zhang

Entropy regularized optimal transport and its multi-marginal generalization have attracted increasing attention in various applications, in particular due to efficient Sinkhorn-like algorithms for computing optimal transport plans. However,…

Optimization and Control · Mathematics 2023-01-25 Florian Beier , Johannes von Lindheim , Sebastian Neumayer , Gabriele Steidl

In our previous work [arXiv:2202.10042], the complexity of Sinkhorn iteration is reduced from $O(N^2)$ to the optimal $O(N)$ by leveraging the special structure of the kernel matrix. In this paper, we explore the special structure of kernel…

Optimization and Control · Mathematics 2022-06-22 Qichen Liao , Zihao Wang , Jing Chen , Bo Bai , Shi Jin , Hao Wu

Optimal transport (OT) has profoundly impacted machine learning by providing theoretical and computational tools to realign datasets. In this context, given two large point clouds of sizes $n$ and $m$ in $\mathbb{R}^d$, entropic OT (EOT)…

In this paper, we propose a unified two-phase scheme to accelerate any high-order regularized tensor approximation approach on the smooth part of a composite convex optimization model. The proposed scheme has the advantage of not needing to…

Optimization and Control · Mathematics 2020-07-06 Bo Jiang , Tianyi Lin , Shuzhong Zhang

In this work we propose a batch version of the Greenkhorn algorithm for multimarginal regularized optimal transport problems. Our framework is general enough to cover, as particular cases, some existing algorithms like Sinkhorn and…

Machine Learning · Statistics 2021-12-07 Vladimir Kostic , Saverio Salzo , Massimilano Pontil

Anderson acceleration (AA) is a technique for accelerating the convergence of fixed-point iterations. In this paper, we apply AA to a sequence of functions and modify the norm in its internal optimization problem to the $\mathcal{H}^{-s}$…

Numerical Analysis · Mathematics 2021-09-14 Yunan Yang , Alex Townsend , Daniel Appelö

Entropy regularization in optimal transport (OT) has been the driver of many recent interests for Wasserstein metrics and barycenters in machine learning. It allows to keep the appealing geometrical properties of the unregularized…

Machine Learning · Statistics 2020-06-05 Hicham Janati , Marco Cuturi , Alexandre Gramfort

The Sinkhorn "distance", a variant of the Wasserstein distance with entropic regularization, is an increasingly popular tool in machine learning and statistical inference. However, the time and memory requirements of standard algorithms for…

Machine Learning · Statistics 2021-11-16 Jason Altschuler , Francis Bach , Alessandro Rudi , Jonathan Niles-Weed

Reduced order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics…

Numerical Analysis · Mathematics 2025-01-13 Moaad Khamlich , Federico Pichi , Gianluigi Rozza

Regularization techniques are necessary to compute meaningful solutions to discrete ill-posed inverse problems. The well-known 2-norm Tikhonov regularization method equipped with a discretization of the gradient operator as regularization…

Numerical Analysis · Mathematics 2024-06-05 Silvia Gazzola , Ali Gholami

We show that Nesterov acceleration is an optimal-order iterative regularization method for linear ill-posed problems provided that a parameter is chosen accordingly to the smoothness of the solution. This result is proven both for an a…

Numerical Analysis · Mathematics 2021-07-07 Stefan Kindermann

\emph{Optimal Transport} (OT) has emerged as an important computational tool in machine learning and computer vision, providing a geometrical framework for studying probability measures. OT unfortunately suffers from the curse of…

Machine Learning · Computer Science 2021-02-08 Anton Mallasto

In the field of optimal transport, two prominent subfields face each other: (i) unregularized optimal transport, "\`a-la-Kantorovich", which leads to extremely sparse plans but with algorithms that scale poorly, and (ii)…

Machine Learning · Computer Science 2024-02-19 Ehsan Amid , Frank Nielsen , Richard Nock , Manfred K. Warmuth

Vector-quantized networks (VQNs) have exhibited remarkable performance across various tasks, yet they are prone to training instability, which complicates the training process due to the necessity for techniques such as subtle…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Borui Zhang , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic…

Numerical Analysis · Mathematics 2018-03-06 Jean-David Benamou , Guillaume Carlier , Luca Nenna

In this paper we propose a unified two-phase scheme for convex optimization to accelerate: (1) the adaptive cubic regularization methods with exact/inexact Hessian matrices, and (2) the adaptive gradient method, without any knowledge of the…

Optimization and Control · Mathematics 2017-12-29 Bo Jiang , Tianyi Lin , Shuzhong Zhang

Transportation cost is an attractive similarity measure between probability distributions due to its many useful theoretical properties. However, solving optimal transport exactly can be prohibitively expensive. Therefore, there has been…

Machine Learning · Computer Science 2019-11-04 Nathaniel Lahn , Deepika Mulchandani , Sharath Raghvendra

Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems are commonly solved…

Machine Learning · Statistics 2025-12-30 O. Deniz Akyildiz , Pierre Del Moral , Joaquín Miguez