English
Related papers

Related papers: Diffeomorphic Registration using Sinkhorn Divergen…

200 papers

Diffeomorphic deformable image registration is one of the crucial tasks in medical image analysis, which aims to find a unique transformation while preserving the topology and invertibility of the transformation. Deep convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-02-09 Ameneh Sheikhjafari , Michelle Noga , Kumaradevan Punithakumar , Nilanjan Ray

In this paper, we propose a new framework named Communication Optimal Transport (CommOT) for computing the rate distortion (RD) function. This work is motivated by observing the fact that the transition law and the relative entropy in…

Information Theory · Computer Science 2022-12-21 Shitong Wu , Wenhao Ye , Hao Wu , Huihui Wu , Wenyi Zhang , Bo Bai

Deformable image registration is one of the fundamental tasks in medical imaging. Classical registration algorithms usually require a high computational cost for iterative optimizations. Although deep-learning-based methods have been…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Boah Kim , Inhwa Han , Jong Chul Ye

The ability to compare two degenerate probability distributions (i.e. two probability distributions supported on two distinct low-dimensional manifolds living in a much higher-dimensional space) is a crucial problem arising in the…

Machine Learning · Statistics 2017-10-23 Aude Genevay , Gabriel Peyré , Marco Cuturi

This paper exploit the equivalence between the Schr\"odinger Bridge problem and the entropy penalized optimal transport in order to find a different approach to the duality, in the spirit of optimal transport. This approach results in a…

Probability · Mathematics 2019-11-19 Simone Di Marino , Augusto Gerolin

While the optimal transport (OT) problem was originally formulated as a linear program, the addition of entropic regularization has proven beneficial both computationally and statistically, for many applications. The Sinkhorn fixed-point…

Machine Learning · Statistics 2023-04-06 James Thornton , Marco Cuturi

Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic…

Numerical Analysis · Mathematics 2018-03-06 Jean-David Benamou , Guillaume Carlier , Luca Nenna

A common way to quantify the ,,distance'' between measures is via their discrepancy, also known as maximum mean discrepancy (MMD). Discrepancies are related to Sinkhorn divergences $S_\varepsilon$ with appropriate cost functions as…

Optimization and Control · Mathematics 2020-08-25 Sebastian Neumayer , Gabriele Steidl

We study Benamou's domain decomposition algorithm for optimal transport in the entropy regularized setting. The key observation is that the regularized variant converges to the globally optimal solution under very mild assumptions. We prove…

Optimization and Control · Mathematics 2021-11-23 Mauro Bonafini , Bernhard Schmitzer

Several recent applications of optimal transport (OT) theory to machine learning have relied on regularization, notably entropy and the Sinkhorn algorithm. Because matrix-vector products are pervasive in the Sinkhorn algorithm, several…

Machine Learning · Statistics 2021-03-09 Meyer Scetbon , Marco Cuturi , Gabriel Peyré

We show that the derivatives of the Sinkhorn-Knopp algorithm, or iterative proportional fitting procedure, converge towards the derivatives of the entropic regularization of the optimal transport problem with a locally uniform linear…

Optimization and Control · Mathematics 2022-08-04 Edouard Pauwels , Samuel Vaiter

Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes…

Machine Learning · Computer Science 2024-06-21 Gen Li , Yanxi Chen , Yu Huang , Yuejie Chi , H. Vincent Poor , Yuxin Chen

In this article we explore an algorithm for diffeomorphic random sampling of nonuniform probability distributions on Riemannian manifolds. The algorithm is based on optimal information transport (OIT)---an analogue of optimal mass transport…

Numerical Analysis · Mathematics 2018-07-20 Martin Bauer , Sarang Joshi , Klas Modin

A statistical framework is introduced for a broad class of problems involving synchronization or registration of data across a sensor network in the presence of noise. This framework enables an estimation-theoretic approach to the design…

Networking and Internet Architecture · Computer Science 2010-10-15 Stephen D. Howard , Douglas Cochran , William Moran , Frederick R. Cohen

We investigate the convergence rate of multi-marginal optimal transport costs that are regularized with the Boltzmann-Shannon entropy, as the noise parameter $\varepsilon$ tends to $0$. We establish lower and upper bounds on the difference…

Optimization and Control · Mathematics 2025-04-30 Luca Nenna , Paul Pegon

Matrix scaling problems with sparse cost matrices arise frequently in various domains, such as optimal transport, image processing, and machine learning. The Sinkhorn-Knopp algorithm is a popular iterative method for solving these problems,…

Optimization and Control · Mathematics 2024-06-26 Jose Rafael Espinosa Mena

We propose an entropic approximation approach for optimal transportation problems with a supremal cost. We establish $\Gamma$-convergence for suitably chosen parameters for the entropic penalization and that this procedure selects…

Analysis of PDEs · Mathematics 2023-02-24 Guillaume Carlier , Camilla Brizzi , Luigi De Pascale

Sinkhorn's algorithm is a method of choice to solve large-scale optimal transport (OT) problems. In this context, it involves an inverse temperature parameter $\beta$ that determines the speed-accuracy trade-off. To improve this trade-off,…

Machine Learning · Computer Science 2024-08-22 Lénaïc Chizat

The nested distance builds on the Wasserstein distance to quantify the difference of stochastic processes, including also the information modelled by filtrations. The Sinkhorn divergence is a relaxation of the Wasserstein distance, which…

Optimization and Control · Mathematics 2021-02-11 Alois Pichler , Michael Weinhardt

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré
‹ Prev 1 3 4 5 6 7 10 Next ›