English
Related papers

Related papers: Accelerating Sinkhorn for Entropy-Regularized Opti…

200 papers

Numerically solving multi-marginal optimal transport (MMOT) problems is computationally prohibitive, even for moderate-scale instances involving $l\ge4$ marginals with support sizes of $N\ge1000$. The cost in MMOT is represented as a tensor…

Numerical Analysis · Mathematics 2026-04-03 Chunhui Chen , Jing Chen , Baojia Luo , Shi Jin , Hao Wu

In this manuscript we would like to address the classical optimization problem of minimizing a proper, convex and lower semicontinuous function via the second order in time dynamics, combining viscous and Hessian-driven damping with a…

Optimization and Control · Mathematics 2023-03-20 Mikhail Karapetyants

This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to…

Machine Learning · Statistics 2018-07-17 Arnaud Dessein , Nicolas Papadakis , Jean-Luc Rouas

In this paper we determine quantitative stability bounds for the Hessian of entropic potentials, \ie, the dual solution to the entropic optimal transport problem. To the authors' knowledge this is the first work addressing this second-order…

Probability · Mathematics 2025-11-14 Giacomo Greco , Luca Tamanini

We propose a novel neural algorithm for the fundamental problem of computing the entropic optimal transport (EOT) plan between continuous probability distributions which are accessible by samples. Our algorithm is based on the saddle point…

Machine Learning · Computer Science 2023-11-02 Nikita Gushchin , Alexander Kolesov , Alexander Korotin , Dmitry Vetrov , Evgeny Burnaev

In 2012, Pflug and Pichler proved, under regularity assumptions, that the value function in Multistage Stochastic Programming (MSP) is Lipschitz continuous w.r.t. the Nested Distance, which is a distance between scenario trees (or discrete…

Optimization and Control · Mathematics 2021-07-22 Zheng Qu , Benoît Tran

We study the multi-marginal partial optimal transport (POT) problem between $m$ discrete (unbalanced) measures with at most $n$ supports. We first prove that we can obtain two equivalence forms of the multimarginal POT problem in terms of…

Machine Learning · Statistics 2022-02-25 Khang Le , Huy Nguyen , Tung Pham , Nhat Ho

Much recent interest has focused on the design of optimization algorithms from the discretization of an associated optimization flow, i.e., a system of differential equations (ODEs) whose trajectories solve an associated optimization…

Optimization and Control · Mathematics 2022-02-02 Pedro Cisneros-Velarde , Francesco Bullo

The Self-Optimal-Transport (SOT) feature transform is designed to upgrade the set of features of a data instance to facilitate downstream matching or grouping related tasks. The transformed set encodes a rich representation of high order…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Daniel Shalam , Simon Korman

Alternating minimization (AM) procedures are practically efficient in many applications for solving convex and non-convex optimization problems. On the other hand, Nesterov's accelerated gradient is theoretically optimal first-order method…

Optimization and Control · Mathematics 2021-09-16 Sergey Guminov , Pavel Dvurechensky , Nazarii Tupitsa , Alexander Gasnikov

Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is…

Matrix scaling problems with sparse cost matrices arise frequently in various domains, such as optimal transport, image processing, and machine learning. The Sinkhorn-Knopp algorithm is a popular iterative method for solving these problems,…

Optimization and Control · Mathematics 2024-06-26 Jose Rafael Espinosa Mena

We investigate the use of entropy-regularized optimal transport (EOT) cost in developing generative models to learn implicit distributions. Two generative models are proposed. One uses EOT cost directly in an one-shot optimization problem…

Machine Learning · Computer Science 2019-08-01 Dong Liu , Minh Thành Vu , Saikat Chatterjee , Lars K. Rasmussen

We propose the Entropic-regularized Robust Optimal Transport (E-ROBOT) framework, a novel method that combines the robustness of ROBOT with the computational and statistical benefits of entropic regularization. We show that, rooted in the…

Machine Learning · Statistics 2025-09-16 Davide La Vecchia , Hang Liu

Chaos arises in many complex dynamical systems, from weather to power grids, but is difficult to accurately model using data-driven emulators, including neural operator architectures. For chaotic systems, the inherent sensitivity to initial…

Machine Learning · Statistics 2026-04-24 Gabriel Melo , Leonardo Santiago , Peter Y. Lu

Entropic optimal transport problems play an increasingly important role in machine learning and generative modelling. In contrast with optimal transport maps which often have limited applicability in high dimensions, Schrodinger bridges can…

Probability · Mathematics 2026-01-21 Pierre Del Moral , Ajay Jasra

We consider the fundamental problem of sampling the optimal transport coupling between given source and target distributions. In certain cases, the optimal transport plan takes the form of a one-to-one mapping from the source support to the…

Machine Learning · Computer Science 2025-10-28 Mara Daniels , Tyler Maunu , Paul Hand

Flow models transform data gradually from one modality (e.g. noise) onto another (e.g. images). Such models are parameterized by a time-dependent velocity field, trained to fit segments connecting pairs of source and target points. When the…

Machine Learning · Computer Science 2025-10-01 Stephen Zhang , Alireza Mousavi-Hosseini , Michal Klein , Marco Cuturi

The {\it forward-backward algorithm} is a powerful tool for solving optimization problems with a {\it additively separable} and {\it smooth} + {\it nonsmooth} structure. In the convex setting, a simple but ingenious acceleration scheme…

Optimization and Control · Mathematics 2017-05-18 Hedy Attouch , Juan Peypouquet

We derive iterative scaling algorithms of the Sinkhorn-Knopp (SK) type for constrained optimal transport. The constraints are in the form of prior-imposed zeroes in the transport plan. Based on classical Bregman arguments, we prove…

Optimization and Control · Mathematics 2024-04-02 Martin Corless , Anthony Quinn , Sarah Boufelja , Robert Shorten