English
Related papers

Related papers: Optimal Transport with Adaptive Regularisation

200 papers

Transformers have achieved state-of-the-art performance in numerous tasks. In this paper, we propose a continuous-time formulation of transformers. Specifically, we consider a dynamical system whose governing equation is parametrized by…

Machine Learning · Computer Science 2025-02-03 Kelvin Kan , Xingjian Li , Stanley Osher

Regularizing the optimal transport (OT) problem has proven crucial for OT theory to impact the field of machine learning. For instance, it is known that regularizing OT problems with entropy leads to faster computations and better…

Machine Learning · Statistics 2020-08-04 François-Pierre Paty , Marco Cuturi

This work studies how the introduction of the entropic regularization term in unbalanced Optimal Transport (OT) models may alter their homogeneity with respect to the input measures. We observe that in common settings (including balanced OT…

Optimization and Control · Mathematics 2022-01-07 Théo Lacombe

Optimal transport (OT) measures distances between distributions in a way that depends on the geometry of the sample space. In light of recent advances in computational OT, OT distances are widely used as loss functions in machine learning.…

Methodology · Statistics 2021-06-22 Debarghya Mukherjee , Aritra Guha , Justin Solomon , Yuekai Sun , Mikhail Yurochkin

Optimal transport (OT) is a versatile framework for comparing probability measures, with many applications to statistics, machine learning, and applied mathematics. However, OT distances suffer from computational and statistical scalability…

Statistics Theory · Mathematics 2022-06-08 Ziv Goldfeld , Kengo Kato , Gabriel Rioux , Ritwik Sadhu

Optimal transport (OT) naturally arises in a wide range of machine learning applications but may often become the computational bottleneck. Recently, one line of works propose to solve OT approximately by searching the \emph{transport plan}…

Machine Learning · Computer Science 2021-11-15 Weijie Liu , Chao Zhang , Nenggan Zheng , Hui Qian

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

Machine Learning · Computer Science 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Quadratic regularization has emerged as a potential alternative to the popular entropic regularization in computational optimal transport, offering the theoretical advantage of producing sparse couplings through its hinge density structure.…

Optimization and Control · Mathematics 2026-05-27 Long Nguyen-Chi , Nam Nguyen , Binh Nguyen

Adapted optimal transport (AOT) problems are optimal transport problems for distributions of a time series where couplings are constrained to have a temporal causal structure. In this paper, we develop computational tools for solving AOT…

Probability · Mathematics 2023-04-26 Stephan Eckstein , Gudmund Pammer

Capacity constrained optimal transport is a variant of optimal transport, which adds extra constraints on the set of feasible couplings in the original optimal transport problem to limit the mass transported between each pair of source and…

Optimization and Control · Mathematics 2025-02-13 Tianhao Wu , Qihao Cheng , Zihao Wang , Chaorui Zhang , Bo Bai , Zhongyi Huang , Hao Wu

Estimating optimal transport (OT) maps (a.k.a. Monge maps) between two measures $P$ and $Q$ is a problem fraught with computational and statistical challenges. A promising approach lies in using the dual potential functions obtained when…

Optimization and Control · Mathematics 2022-06-20 Aram-Alexandre Pooladian , Marco Cuturi , Jonathan Niles-Weed

This paper concerns the application of techniques from optimal transport (OT) to mean field control, in which the probability measures of interest in OT correspond to empirical distributions associated with a large collection of controlled…

Optimization and Control · Mathematics 2025-06-23 Thomas Le Corre , Ana Busic , Sean Meyn

In several applications, including imaging of deformable objects while in motion, simultaneous localization and mapping, and unlabeled sensing, we encounter the problem of recovering a signal that is measured subject to unknown…

Information Theory · Computer Science 2021-03-15 Yanting Ma , Petros T. Boufounos , Hassan Mansour , Shuchin Aeron

Optimal transport (OT) defines a powerful framework to compare probability distributions in a geometrically faithful way. However, the practical impact of OT is still limited because of its computational burden. We propose a new class of…

Optimization and Control · Mathematics 2016-05-30 Genevay Aude , Marco Cuturi , Gabriel Peyré , Francis Bach

Unbalanced optimal transport (UOT) is a natural extension of optimal transport (OT) allowing comparison between measures of different masses. It arises naturally in machine learning by offering a robustness against outliers. The aim of this…

Optimization and Control · Mathematics 2025-10-06 Luca Nenna , Paul Pegon , Louis Tocquec

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

Machine Learning · Statistics 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

Optimal transport (OT) serves as a natural framework for comparing probability measures, with applications in statistics, machine learning, and applied mathematics. Alas, statistical estimation and exact computation of the OT distances…

Statistics Theory · Mathematics 2024-05-14 Tao Wang , Ziv Goldfeld

We propose novel fast algorithms for optimal transport (OT) utilizing a cyclic symmetry structure of input data. Such OT with cyclic symmetry appears universally in various real-world examples: image processing, urban planning, and graph…

Machine Learning · Computer Science 2023-11-23 Shoichiro Takeda , Yasunori Akagi , Naoki Marumo , Kenta Niwa

The modeling of phenomenological structure is a crucial aspect in inverse imaging problems. One emerging modeling tool in computational imaging is the optimal transport framework. Its ability to model geometric displacements across an…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 John Lee , Nicholas P. Bertrand , Christopher J. Rozell