English
Related papers

Related papers: Gromov-Wasserstein Distances: Entropic Regularizat…

200 papers

The optimal transport (OT) problem is a classical optimization problem having the form of linear programming. Machine learning applications put forward new computational challenges in its solution. In particular, the OT problem defines a…

Optimization and Control · Mathematics 2022-10-25 Nazarii Tupitsa , Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov

This paper studies convergence of empirical measures smoothed by a Gaussian kernel. Specifically, consider approximating $P\ast\mathcal{N}_\sigma$, for $\mathcal{N}_\sigma\triangleq\mathcal{N}(0,\sigma^2 \mathrm{I}_d)$, by…

Statistics Theory · Mathematics 2020-05-04 Ziv Goldfeld , Kristjan Greenewald , Yury Polyanskiy , Jonathan Weed

We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any…

Machine Learning · Computer Science 2017-11-21 Yukun Chen , Jianbo Ye , Jia Li

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

Numerical Analysis · Mathematics 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

This is an expository paper on the theory of gradient flows, and in particular of those PDEs which can be interpreted as gradient flows for the Wasserstein metric on the space of probability measures (a distance induced by optimal…

Analysis of PDEs · Mathematics 2016-09-14 Filippo Santambrogio

Optimal transport (\OT) theory defines a powerful set of tools to compare probability distributions. \OT~suffers however from a few drawbacks, computational and statistical, which have encouraged the proposal of several regularized variants…

Machine Learning · Statistics 2019-10-29 Tam Le , Makoto Yamada , Kenji Fukumizu , Marco Cuturi

We study finite-sample statistical performance guarantees for distributionally robust optimization (DRO) with optimal transport (OT) and OT-regularized divergence model neighborhoods. Specifically, we derive concentration inequalities for…

Machine Learning · Statistics 2026-03-31 Jeremiah Birrell , Xiaoxi Shen

We propose a learning framework for graph kernels, which is theoretically grounded on regularizing optimal transport. This framework provides a novel optimal transport distance metric, namely Regularized Wasserstein (RW) discrepancy, which…

Machine Learning · Computer Science 2021-10-11 Asiri Wijesinghe , Qing Wang , Stephen Gould

In this work, we propose a novel approach for subgraph matching, the problem of finding a given query graph in a large source graph, based on the fused Gromov-Wasserstein distance. We formulate the subgraph matching problem as a partial…

Information Theory · Computer Science 2024-07-01 Wen-Xin Pan , Isabel Haasler , Pascal Frossard

We study the convergence of entropically regularized optimal transport to optimal transport. The main result is concerned with the convergence of the associated optimizers and takes the form of a large deviations principle quantifying the…

Optimization and Control · Mathematics 2022-01-25 Espen Bernton , Promit Ghosal , Marcel Nutz

This paper considers the problem of estimating a matrix that encodes pairwise distances in a finite metric space (or, more generally, the edge weight matrix of a network) under the barycentric coding model (BCM) with respect to the…

Optimization and Control · Mathematics 2026-03-31 Rocío Díaz Martín , Ivan V. Medri , James M. Murphy

The properties of gravitational-wave (GW) propagation are modified in alternative theories of gravity and are crucial observables to test gravity at cosmological distance. The propagation speed has already been measured from GW170817 so…

General Relativity and Quantum Cosmology · Physics 2019-05-22 Atsushi Nishizawa , Shun Arai

The $2$-Wasserstein distance is sensitive to minor geometric differences between distributions, making it a very powerful dissimilarity metric. However, due to this sensitivity, a small outlier mass can also cause a significant increase in…

Machine Learning · Computer Science 2024-06-04 Sharath Raghvendra , Pouyan Shirzadian , Kaiyi Zhang

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

Machine Learning · Computer Science 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

Distributed distribution comparison aims to measure the distance between the distributions whose data are scattered across different agents in a distributed system and cannot even be shared directly among the agents. In this study, we…

Machine Learning · Computer Science 2024-07-23 Xiangfeng Wang , Hongteng Xu , Moyi Yang

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li

Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with…

Optimization and Control · Mathematics 2026-05-11 Gabriel Peyré

Computing the quadratic transportation metric (also called the $2$-Wasserstein distance or root mean square distance) between two point clouds, or, more generally, two discrete distributions, is a fundamental problem in machine learning,…

Data Structures and Algorithms · Computer Science 2018-12-18 Jason Altschuler , Francis Bach , Alessandro Rudi , Jonathan Weed
‹ Prev 1 8 9 10 Next ›