English
Related papers

Related papers: Importance Sparsification for Sinkhorn Algorithm

200 papers

The Sinkhorn "distance", a variant of the Wasserstein distance with entropic regularization, is an increasingly popular tool in machine learning and statistical inference. However, the time and memory requirements of standard algorithms for…

Machine Learning · Statistics 2021-11-16 Jason Altschuler , Francis Bach , Alessandro Rudi , Jonathan Niles-Weed

The purpose of this work is to develop a framework to calibrate signed datasets so as to be consistent with specified marginals by suitably extending the Schr\"odinger-Fortet-Sinkhorn paradigm. Specifically, we seek to revise…

Machine Learning · Statistics 2023-08-24 Anqi Dong , Tryphon T. Georgiou , Allen Tannenbaum

Computing optimal transport distances such as the earth mover's distance is a fundamental problem in machine learning, statistics, and computer vision. Despite the recent introduction of several algorithms with good empirical performance,…

Data Structures and Algorithms · Computer Science 2018-02-08 Jason Altschuler , Jonathan Weed , Philippe Rigollet

Optimal Transport (OT) theory has seen an increasing amount of attention from the computer science community due to its potency and relevance in modeling and machine learning. It introduces means that serve as powerful ways to compare…

Machine Learning · Computer Science 2021-06-04 Luis Caicedo Torres , Luiz Manella Pereira , M. Hadi Amini

We propose to tackle the problem of understanding the effect of regularization in Sinkhorn algotihms. In the case of Gaussian distributions we provide a closed form for the regularized optimal transport which enables to provide a better…

Statistics Theory · Mathematics 2020-06-16 Eustasio del Barrio , Jean-Michel Loubes

Optimal transport (OT) is a popular tool in machine learning to compare probability measures geometrically, but it comes with substantial computational burden. Linear programming algorithms for computing OT distances scale cubically in the…

Machine Learning · Computer Science 2022-03-24 Gaspard Beugnot , Aude Genevay , Kristjan Greenewald , Justin Solomon

Optimal transport (OT) naturally arises in a wide range of machine learning applications but may often become the computational bottleneck. Recently, one line of works propose to solve OT approximately by searching the \emph{transport plan}…

Machine Learning · Computer Science 2021-11-15 Weijie Liu , Chao Zhang , Nenggan Zheng , Hui Qian

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai

The Schr\"odinger bridge problem seeks the optimal stochastic process that connects two given probability distributions with minimal energy modification. While the Sinkhorn algorithm is widely used to solve the static optimal transport…

Machine Learning · Statistics 2025-10-28 Ibuki Maeda , Rentian Yao , Atsushi Nitanda

Computing the empirical Wasserstein distance in the Wasserstein-distance-based independence test is an optimal transport (OT) problem with a special structure. This observation inspires us to study a special type of OT problem and propose a…

Optimization and Control · Mathematics 2023-03-02 Yiling Xie , Yiling Luo , Xiaoming Huo

The notion of vertex sparsification is introduced in \cite{M}, where it was shown that for any graph $G = (V, E)$ and a subset of $k$ terminals $K \subset V$, there is a polynomial time algorithm to construct a graph $H = (K, E_H)$ on just…

Data Structures and Algorithms · Computer Science 2010-06-24 Moses Charikar , Tom Leighton , Shi Li , Ankur Moitra

We propose a new regularized optimal transport (OT) formulation, termed sliced-regularized optimal transport (SROT). Unlike entropic OT (EOT), which regularizes the transport plan toward an independent coupling, SROT regularizes it toward a…

Machine Learning · Statistics 2026-05-21 Khai Nguyen

Entropic optimal transport problems play an increasingly important role in machine learning and generative modelling. In contrast with optimal transport maps which often have limited applicability in high dimensions, Schrodinger bridges can…

Probability · Mathematics 2026-01-21 Pierre Del Moral , Ajay Jasra

We study the potential utility of classical techniques of spectral sparsification of graphs as a preprocessing step for digital quantum algorithms, in particular, for Hamiltonian simulation. Our results indicate that spectral sparsification…

Quantum Physics · Physics 2019-10-08 Steven Herbert , Sathyawageeswar Subramanian

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in…

Machine Learning · Statistics 2022-03-18 Xiao-Tong Yuan , Ping Li

Partial Optimal Transport (POT) has recently emerged as a central tool in various Machine Learning (ML) applications. It lifts the stringent assumption of the conventional Optimal Transport (OT) that input measures are of equal masses,…

We introduce a new paradigm, $\textit{measure synchronization}$, for synchronizing graphs with measure-valued edges. We formulate this problem as maximization of the cycle-consistency in the space of probability measures over relative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Tolga Birdal , Michael Arbel , Umut Şimşekli , Leonidas Guibas

In this paper, we study the Entropic Martingale Optimal Transport (EMOT) problem on \mathbb{R}. The investigation of the EMOT problem arises in the calibration problem of the Stochastic Volatility Models, where martingale constraints…

Probability · Mathematics 2026-02-16 Fan Chen , Giovanni Conforti , Zhenjie Ren , Xiaozhen Wang

We consider the problem of minimizing a functional over a parametric family of probability measures, where the parameterization is characterized via a push-forward structure. An important application of this problem is in training…

Machine Learning · Statistics 2020-11-10 Zebang Shen , Zhenfu Wang , Alejandro Ribeiro , Hamed Hassani

In this paper, we propose the optimal production transport model, which is an extension of the classical optimal transport model. We observe in economics, the production of the factories can always be adjusted within a certain range, while…

Optimization and Control · Mathematics 2025-07-02 Jie Fan , Tianhao Wu , Hao Wu