English
Related papers

Related papers: Using Sinkhorn in the JKO scheme adds linear diffu…

200 papers

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

Machine Learning · Computer Science 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

We consider the numerical solution of the discrete multi-marginal optimal transport (MOT) by means of the Sinkhorn algorithm. In general, the Sinkhorn algorithm suffers from the curse of dimensionality with respect to the number of…

Optimization and Control · Mathematics 2023-02-22 Fatima Antarou Ba , Michael Quellmalz

Schr\"{o}dinger bridge is a stochastic optimal control problem to steer a given initial state density to another, subject to controlled diffusion and deadline constraints. A popular method to numerically solve the Schr\"{o}dinger bridge…

Optimization and Control · Mathematics 2023-09-14 Alexis M. H. Teter , Yongxin Chen , Abhishek Halder

Optimal transport (OT) has become a widely used tool in the machine learning field to measure the discrepancy between probability distributions. For instance, OT is a popular loss function that quantifies the discrepancy between an…

Machine Learning · Computer Science 2022-12-27 Shintaro Nakamura , Han Bao , Masashi Sugiyama

Optimal transport (OT) provides powerful tools for comparing probability measures in various types. The Wasserstein distance which arises naturally from the idea of OT is widely used in many machine learning applications. Unfortunately,…

Optimization and Control · Mathematics 2021-06-03 Shu Liu , Haodong Sun , Hongyuan Zha

We consider robust variants of the standard optimal transport, named robust optimal transport, where marginal constraints are relaxed via Kullback-Leibler divergence. We show that Sinkhorn-based algorithms can approximate the optimal cost…

Machine Learning · Computer Science 2021-10-29 Khang Le , Huy Nguyen , Quang Nguyen , Tung Pham , Hung Bui , Nhat Ho

In this paper we determine quantitative stability bounds for the Hessian of entropic potentials, \ie, the dual solution to the entropic optimal transport problem. To the authors' knowledge this is the first work addressing this second-order…

Probability · Mathematics 2025-11-14 Giacomo Greco , Luca Tamanini

Motivated by modern machine learning applications where we only have access to empirical measures constructed from finite samples, we relax the marginal constraints of the classical Schr\"odinger bridge problem by penalizing the transport…

Probability · Mathematics 2026-02-10 Yifan Jiang , Renyuan Xu , Luhao Zhang

We propose the Entropic-regularized Robust Optimal Transport (E-ROBOT) framework, a novel method that combines the robustness of ROBOT with the computational and statistical benefits of entropic regularization. We show that, rooted in the…

Machine Learning · Statistics 2025-09-16 Davide La Vecchia , Hang Liu

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

Correctly estimating the discrepancy between two data distributions has always been an important task in Machine Learning. Recently, Cuturi proposed the Sinkhorn distance which makes use of an approximate Optimal Transport cost between two…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Ying Lu , Liming Chen , Alexandre Saidi , Xianfeng Gu

This article describes a set of methods for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn--Knopp…

Numerical Analysis · Mathematics 2021-04-02 Alexis Thibault , Lénaïc Chizat , Charles Dossal , Nicolas Papadakis

Although Sinkhorn divergences are now routinely used in data sciences to compare probability distributions, the computational effort required to compute them remains expensive, growing in general quadratically in the size $n$ of the support…

Machine Learning · Statistics 2020-10-27 Meyer Scetbon , Marco Cuturi

The purpose of this work is to develop a framework to calibrate signed datasets so as to be consistent with specified marginals by suitably extending the Schr\"odinger-Fortet-Sinkhorn paradigm. Specifically, we seek to revise…

Machine Learning · Statistics 2023-08-24 Anqi Dong , Tryphon T. Georgiou , Allen Tannenbaum

We propose a procedure for estimating the Schr\"odinger bridge between two probability distributions. Unlike existing approaches, our method does not require iteratively simulating forward and backward diffusions or training neural networks…

Machine Learning · Statistics 2024-08-22 Aram-Alexandre Pooladian , Jonathan Niles-Weed

Optimal Transport is a popular distance metric for measuring similarity between distributions. Exact algorithms for computing Optimal Transport can be slow, which has motivated the development of approximate numerical solvers (e.g. Sinkhorn…

Machine Learning · Computer Science 2022-03-09 Nathaniel Lahn , Sharath Raghvendra , Kaiyi Zhang

We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method…

Optimization and Control · Mathematics 2018-02-12 Christoph Brauer , Christian Clason , Dirk Lorenz , Benedikt Wirth

Consider a reference Markov process with initial distribution $\pi_{0}$ and transition kernels $\{M_{t}\}_{t\in[1:T]}$, for some $T\in\mathbb{N}$. Assume that you are given distribution $\pi_{T}$, which is not equal to the marginal…

Computation · Statistics 2020-01-01 Espen Bernton , Jeremy Heng , Arnaud Doucet , Pierre E. Jacob

We study the Wasserstein gradient flow of semi-discrete energies in the space of probability measures, that is functionals depending on two measures-one being an absolutely continuous density and the other an atomic measure. These energies…

Analysis of PDEs · Mathematics 2026-03-05 Joao Miguel Machado

Following a celebrated paper by Jordan, Kinderleherer and Otto it is possible to discretize in time the Fokker-Planck equation $\partial_t\varrho=\Delta\varrho+\nabla\cdot(\rho\nabla V)$ by solving a sequence of iterated variational…

Optimization and Control · Mathematics 2022-06-28 Filippo Santambrogio , Gayrat Toshpulatov