English
Related papers

Related papers: Exponential Convergence of Sinkhorn Under Regulari…

200 papers

We introduce the Sinkhorn treatment effect, an entropic optimal transport measure of divergence between counterfactual distributions. Unlike classical quantities such as the average treatment effect, this measure captures differences across…

Machine Learning · Statistics 2026-05-12 Medha Agarwal , Alex Luedtke

The diffeomorphic registration framework enables to define an optimal matching function between two probability measures with respect to a data-fidelity loss function. The non convexity of the optimization problem renders the choice of this…

Statistics Theory · Mathematics 2022-11-24 Lucas de Lara , Alberto González-Sanz , Jean-Michel Loubes

This letter investigates dynamical optimal transport of underactuated linear systems over an infinite time horizon. In our previous work, we proposed to integrate model predictive control and the celebrated Sinkhorn algorithm to perform…

Optimization and Control · Mathematics 2023-08-16 Kaito Ito , Kenji Kashima

We show that the derivatives of the Sinkhorn-Knopp algorithm, or iterative proportional fitting procedure, converge towards the derivatives of the entropic regularization of the optimal transport problem with a locally uniform linear…

Optimization and Control · Mathematics 2022-08-04 Edouard Pauwels , Samuel Vaiter

We prove that the Sinkhorn algorithm converges at a rate of $O(k^{-1} \log k)$ in $\ell_1$-norm marginal error, in the asymptotically scalable case. This almost closes the gap between the lower bound $\Omega(k^{-1})$ (Qu et al., 2025) and…

Optimization and Control · Mathematics 2026-05-15 Guillaume Wang

Matrix scaling and matrix balancing are two basic linear-algebraic problems with a wide variety of applications, such as approximating the permanent, and pre-conditioning linear systems to make them more numerically stable. We study the…

The problem of biclustering consists of the simultaneous clustering of rows and columns of a matrix such that each of the submatrices induced by a pair of row and column clusters is as uniform as possible. In this paper we approximate the…

Data Structures and Algorithms · Computer Science 2008-08-22 Kai Puolamäki , Sami Hanhijärvi , Gemma C. Garriga

Many machine learning algorithms minimize a regularized risk, and stochastic optimization is widely used for this task. When working with massive data, it is desirable to perform stochastic optimization in parallel. Unfortunately, many…

Machine Learning · Statistics 2023-11-27 Shin Matsushima , Hyokun Yun , Xinhua Zhang , S. V. N. Vishwanathan

Distributionally robust optimization (DRO) has emerged as a powerful paradigm for reliable decision-making under uncertainty. This paper focuses on DRO with ambiguity sets defined via the Sinkhorn discrepancy: an entropy-regularized…

Machine Learning · Statistics 2025-12-16 Jie Wang

For a given nonnegative matrix $A=(A_{ij})$, the matrix scaling problem asks whether $A$ can be scaled to a doubly stochastic matrix $D_1AD_2$ for some positive diagonal matrices $D_1,D_2$.The Sinkhorn algorithm is a simple iterative…

Data Structures and Algorithms · Computer Science 2023-06-19 Koyo Hayashi , Hiroshi Hirai , Keiya Sakabe

Optimal transport is a powerful framework for computing distances between probability distributions. We unify the two main approaches to optimal transport, namely Monge-Kantorovitch and Sinkhorn-Cuturi, into what we define as Tsallis…

Machine Learning · Computer Science 2016-09-16 Boris Muzellec , Richard Nock , Giorgio Patrini , Frank Nielsen

Estimation of the precision matrix (or inverse covariance matrix) is of great importance in statistical data analysis and machine learning. However, as the number of parameters scales quadratically with the dimension $p$, computation…

Computation · Statistics 2022-11-02 Qian LI , Binyan Jiang , Defeng Sun

We develop a mathematical theory of entropic regularisation of unbalanced optimal transport problems. Focusing on static formulation and relying on the formalism developed for the unregularised case, we show that unbalanced optimal…

Optimization and Control · Mathematics 2023-05-05 Maciej Buze , Manh Hong Duong

In order to circumvent the difficulties in solving numerically the discrete optimal transport problem, in which one minimizes the linear target function $P\mapsto\langle C,P\rangle:=\sum_{i,j}C_{ij}P_{ij}$, Cuturi introduced a variant of…

Optimization and Control · Mathematics 2020-11-30 Daiji Tsutsui

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not…

Machine Learning · Statistics 2018-11-14 Théo Lacombe , Marco Cuturi , Steve Oudot

Entropically regularized optimal transport between probability measures supported on compact subsets of Euclidean space admits a representation as an information projection under moment inequality constraints. Exploiting this structure, I…

Statistics Theory · Mathematics 2026-01-15 Rami V. Tabri

We study distributed Sinkhorn iterations for entropy-regularized optimal transport when the Gibbs kernel operator is row-partitioned across c workers and cannot be centralized. We present Federated Sinkhorn, two exact synchronous protocols…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Jeremy Kulcsar , Vyacheslav Kungurtsev , Georgios Korpas , Giulio Giaconi , William Shoosmith

The article introduces a new algorithm for solving a class ofequilibrium problems involving strongly pseudomonotone bifunctions with Lipschitz-type condition. We describe how to incorporate the proximal-like regularized technique with…

Optimization and Control · Mathematics 2018-04-26 Dang Van Hieu

Optimal transportation provides a means of lifting distances between points on a geometric domain to distances between signals over the domain, expressed as probability distributions. On a graph, transportation problems can be used to…

Optimization and Control · Mathematics 2018-03-26 Montacer Essid , Justin Solomon