English
Related papers

Related papers: Regularity as Regularization: Smooth and Strongly …

200 papers

Defining meaningful distances between samples in a dataset is a fundamental problem in machine learning. Optimal Transport (OT) lifts a distance between features (the "ground metric") to a geometrically meaningful distance between samples.…

Machine Learning · Statistics 2022-07-20 Geert-Jan Huizing , Laura Cantini , Gabriel Peyré

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

We investigate finding a map $g$ within a function class $G$ that minimises an Optimal Transport (OT) cost between a target measure $\nu$ and the image by $g$ of a source measure $\mu$. This is relevant when an OT map from $\mu$ to $\nu$…

Optimization and Control · Mathematics 2025-08-20 Eloi Tanguy , Agnès Desolneux , Julie Delon

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

Issued from Optimal Transport, the Wasserstein distance has gained importance in Machine Learning due to its appealing geometrical properties and the increasing availability of efficient approximations. In this work, we consider the problem…

Machine Learning · Statistics 2022-02-21 Guillaume Staerman , Pierre Laforgue , Pavlo Mozharovskyi , Florence d'Alché-Buc

We develop a theory of optimal transport relative to a distinguished subset, which acts as a reservoir of mass, allowing us to compare measures of different total variation. This relative transportation problem has an optimal solution and…

Metric Geometry · Mathematics 2026-04-08 Peter Bubenik , Alex Elchesen

It is well known that optimal transport suffers from the curse of dimensionality: when the prescribed marginals are approximated by i.i.d. samples, the convergence of the empirical optimal transport problem to the population counterpart…

Statistics Theory · Mathematics 2025-11-14 Alberto González-Sanz , Eustasio del Barrio , Marcel Nutz

Optimal Transport is a foundational mathematical theory that connects optimization, partial differential equations, and probability. It offers a powerful framework for comparing probability distributions and has recently become an important…

Machine Learning · Statistics 2025-05-13 Gabriel Peyré

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Regularisation theory in Banach spaces, and non--norm-squared regularisation even in finite dimensions, generally relies upon Bregman divergences to replace norm convergence. This is comparable to the extension of first-order optimisation…

Optimization and Control · Mathematics 2021-03-19 Tuomo Valkonen

Projection robust Wasserstein (PRW) distance, or Wasserstein projection pursuit (WPP), is a robust variant of the Wasserstein distance. Recent work suggests that this quantity is more robust than the standard Wasserstein distance, in…

Machine Learning · Computer Science 2023-01-03 Tianyi Lin , Chenyou Fan , Nhat Ho , Marco Cuturi , Michael I. Jordan

The Wasserstein metric or earth mover's distance (EMD) is a useful tool in statistics, machine learning and computer science with many applications to biological or medical imaging, among others. Especially in the light of increasingly…

Optimization and Control · Mathematics 2018-01-26 Jörn Schrieber , Dominic Schuhmacher , Carsten Gottschlich

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

Sinkhorn divergence is a measure of dissimilarity between two probability measures. It is obtained through adding an entropic regularization term to Kantorovich's optimal transport problem and can hence be viewed as an entropically…

Numerical Analysis · Mathematics 2020-05-01 Mohammad Motamed

Optimal transport (OT) is a powerful tool for measuring the distance between two defined probability distributions. In this paper, we develop a new manifold named the coupling matrix manifold (CMM), where each point on CMM can be regarded…

Machine Learning · Computer Science 2019-11-26 Dai Shi , Junbin Gao , Xia Hong , S. T. Boris Choy , Zhiyong Wang

The topic of this study lies in the intersection of two fields. One is related with analyzing transport phenomena in complicated flows.For this purpose, we use so-called coherent sets: non-dispersing, possibly moving regions in the flow's…

Numerical Analysis · Mathematics 2021-07-28 Péter Koltai , Johannes von Lindheim , Sebastian Neumayer , Gabriele Steidl

A regularization algorithm allowing random noise in derivatives and inexact function values is proposed for computing approximate local critical points of any order for smooth unconstrained optimization problems. For an objective function…

Optimization and Control · Mathematics 2021-04-07 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

We study optimal transport-based distributionally robust optimization problems where a fictitious adversary, often envisioned as nature, can choose the distribution of the uncertain problem parameters by reshaping a prescribed reference…

Optimization and Control · Mathematics 2025-10-16 Soroosh Shafiee , Liviu Aolaritei , Florian Dörfler , Daniel Kuhn

Distance metric learning (DML), which learns a distance metric from labeled "similar" and "dissimilar" data pairs, is widely utilized. Recently, several works investigate orthogonality-promoting regularization (OPR), which encourages the…

Machine Learning · Computer Science 2018-02-19 Pengtao Xie , Wei Wu , Yichen Zhu , Eric P. Xing

Although deep neural networks are well-known for their outstanding performance in tackling complex tasks, their hunger for computational resources remains a significant hurdle, posing energy-consumption issues and restricting their…

Machine Learning · Computer Science 2025-07-16 Victor Quétu , Zhu Liao , Nour Hezbri , Fabio Pizzati , Enzo Tartaglione