English
Related papers

Related papers: Data Assimilation for Sign-indefinite Priors: A ge…

200 papers

We introduce a new paradigm, $\textit{measure synchronization}$, for synchronizing graphs with measure-valued edges. We formulate this problem as maximization of the cycle-consistency in the space of probability measures over relative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Tolga Birdal , Michael Arbel , Umut Şimşekli , Leonidas Guibas

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Sinkhorn algorithm has been used pervasively to approximate the solution to optimal transport (OT) and unbalanced optimal transport (UOT) problems. However, its practical application is limited due to the high computational complexity. To…

Machine Learning · Statistics 2026-04-07 Mengyu Li , Jun Yu , Tao Li , Cheng Meng

We show non-asymptotic exponential convergence of Sinkhorn iterates to the Schr\"odinger potentials, solutions of the quadratic Entropic Optimal Transport problem on $\mathbb{R}^ d$. Our results hold under mild assumptions on the marginal…

Probability · Mathematics 2026-05-01 Giovanni Conforti , Alain Durmus , Giacomo Greco

The Sinkhorn operator has recently experienced a surge of popularity in computer vision and related fields. One major reason is its ease of integration into deep learning frameworks. To allow for an efficient training of respective neural…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Marvin Eisenberger , Aysim Toker , Laura Leal-Taixé , Florian Bernard , Daniel Cremers

Self-training is a standard approach to semi-supervised learning where the learner's own predictions on unlabeled data are used as supervision during training. In this paper, we reinterpret this label assignment process as an optimal…

Machine Learning · Computer Science 2021-06-15 Kai Sheng Tai , Peter Bailis , Gregory Valiant

Consider a reference Markov process with initial distribution $\pi_{0}$ and transition kernels $\{M_{t}\}_{t\in[1:T]}$, for some $T\in\mathbb{N}$. Assume that you are given distribution $\pi_{T}$, which is not equal to the marginal…

Computation · Statistics 2020-01-01 Espen Bernton , Jeremy Heng , Arnaud Doucet , Pierre E. Jacob

We provide theoretical analyses for two algorithms that solve the regularized optimal transport (OT) problem between two discrete probability measures with at most $n$ atoms. We show that a greedy variant of the classical Sinkhorn…

Data Structures and Algorithms · Computer Science 2021-07-27 Tianyi Lin , Nhat Ho , Michael I. Jordan

We show that a solution of the optimal assignment problem can be obtained as the limit of the solution of an entropy maximization problem, as a deformation parameter tends to infinity. This allows us to apply entropy maximization algorithms…

Numerical Analysis · Mathematics 2013-11-05 Meisam Sharify , Stéphane Gaubert , Laura Grigori

The matrix scaling problem, particularly the Sinkhorn-Knopp algorithm, has been studied for over 60 years. In practice, the algorithm often yields high-quality approximations within just a few iterations. Theoretically, however, the…

Data Structures and Algorithms · Computer Science 2025-08-12 Kun He

This paper presents consideration of the Semi-Relaxed Sinkhorn (SR-Sinkhorn) algorithm for the semi-relaxed optimal transport (SROT) problem, which relaxes one marginal constraint of the standard OT problem. For evaluation of how the…

Machine Learning · Computer Science 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

We consider the problem of minimizing a functional over a parametric family of probability measures, where the parameterization is characterized via a push-forward structure. An important application of this problem is in training…

Machine Learning · Statistics 2020-11-10 Zebang Shen , Zhenfu Wang , Alejandro Ribeiro , Hamed Hassani

Several recent applications of optimal transport (OT) theory to machine learning have relied on regularization, notably entropy and the Sinkhorn algorithm. Because matrix-vector products are pervasive in the Sinkhorn algorithm, several…

Machine Learning · Statistics 2021-03-09 Meyer Scetbon , Marco Cuturi , Gabriel Peyré

The problem of reconciling a prior probability law on paths with data was introduced by E. Schr\"odinger in 1931/32. It represents an early formulation of a maximum likelihood problem. This specific formulation can also be seen as the…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Asmaa Eldesoukey , Tryphon T. Georgiou

We give the first approximation algorithm for mixed packing and covering semidefinite programs (SDPs) with polylogarithmic dependence on width. Mixed packing and covering SDPs constitute a fundamental algorithmic primitive with recent…

Data Structures and Algorithms · Computer Science 2021-07-13 Arun Jambulapati , Yin Tat Lee , Jerry Li , Swati Padmanabhan , Kevin Tian

In this paper a novel distributed algorithm for blind macro calibration in sensor networks based on output synchronization is proposed. The algorithm is formulated as a set of gradient-type recursions for estimating parameters of sensor…

Systems and Control · Computer Science 2016-03-27 Miloš S. Stanković , Srđan S. Stanković , Karl Henrik Johansson

We study the stability of entropically regularized optimal transport with respect to the marginals. Given marginals converging weakly, we establish a strong convergence for the Schr\"odinger potentials describing the density of the optimal…

Probability · Mathematics 2022-01-26 Marcel Nutz , Johannes Wiesel

We present several new complexity results for the entropic regularized algorithms that approximately solve the optimal transport (OT) problem between two discrete probability measures with at most $n$ atoms. First, we improve the complexity…

Data Structures and Algorithms · Computer Science 2022-05-19 Tianyi Lin , Nhat Ho , Michael I. Jordan

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

Computing the optimal transport distance between statistical distributions is a fundamental task in machine learning. One remarkable recent advancement is entropic regularization and the Sinkhorn algorithm, which utilizes only matrix…

Optimization and Control · Mathematics 2024-01-24 Xun Tang , Michael Shavlovsky , Holakou Rahmanian , Elisa Tardini , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying