English
Related papers

Related papers: Compressed online Sinkhorn

200 papers

The recent emergence of new algorithms for permuting models into functionally equivalent regions of the solution space has shed some light on the complexity of error surfaces, and some promising properties like mode connectivity. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Fidel A. Guerrero Peña , Heitor Rapela Medeiros , Thomas Dubail , Masih Aminbeidokhti , Eric Granger , Marco Pedersoli

This letter investigates dynamical optimal transport of underactuated linear systems over an infinite time horizon. In our previous work, we proposed to integrate model predictive control and the celebrated Sinkhorn algorithm to perform…

Optimization and Control · Mathematics 2023-08-16 Kaito Ito , Kenji Kashima

We develop a new reduction that converts any online convex optimization algorithm suffering $O(\sqrt{T})$ regret into an $\epsilon$-differentially private stochastic convex optimization algorithm with the optimal convergence rate $\tilde…

Machine Learning · Computer Science 2022-10-14 Qinzi Zhang , Hoang Tran , Ashok Cutkosky

This contribution features an accelerated computation of the Sinkhorn's algorithm, which approximates the Wasserstein transportation distance, by employing nonequispaced fast Fourier transforms (NFFT). The algorithm proposed allows…

Optimization and Control · Mathematics 2023-03-07 Rajmadan Lakshmanan , Alois Pichler , Daniel Potts

Optimal transport (OT) finds a least cost transport plan between two probability distributions using a cost matrix defined on pairs of points. Unlike standard OT, which infers unstructured pointwise mappings, low-rank optimal transport…

Machine Learning · Computer Science 2026-03-05 Henri Schmidt , Peter Halmos , Ben Raphael

Optimal transport (OT) plays an essential role in various areas like machine learning and deep learning. However, computing discrete optimal transport plan for large scale problems with adequate accuracy and efficiency is still highly…

Machine Learning · Computer Science 2021-07-20 Dongsheng An , Na Lei , Xianfeng Gu

Optimal Transport (OT) theory has seen an increasing amount of attention from the computer science community due to its potency and relevance in modeling and machine learning. It introduces means that serve as powerful ways to compare…

Machine Learning · Computer Science 2021-06-04 Luis Caicedo Torres , Luiz Manella Pereira , M. Hadi Amini

The Sinkhorn--Knopp (SK) algorithm is a cornerstone method for matrix scaling and entropically regularized optimal transport (EOT). Despite its empirical efficiency, existing theoretical guarantees to achieve a target marginal accuracy…

Data Structures and Algorithms · Computer Science 2026-04-07 Kun He

In this note, we generalize the classical optimal partial transport (OPT) problem by modifying the mass destruction/creation term to function-based terms, introducing what we term ``generalized optimal partial transport'' problems. We then…

Optimization and Control · Mathematics 2024-07-10 Yikun Bai

Optimal transport (OT) has become exceedingly popular in machine learning, data science, and computer vision. The core assumption in the OT problem is the equal total amount of mass in source and target measures, which limits its…

Machine Learning · Computer Science 2023-08-08 Yikun Bai , Berhnard Schmitzer , Mathew Thorpe , Soheil Kolouri

This article describes a set of methods for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn--Knopp…

Numerical Analysis · Mathematics 2021-04-02 Alexis Thibault , Lénaïc Chizat , Charles Dossal , Nicolas Papadakis

Tensor networks represent the state-of-the-art in computational methods across many disciplines, including the classical simulation of quantum many-body systems and quantum circuits. Several applications of current interest give rise to…

Quantum Physics · Physics 2021-03-17 Johnnie Gray , Stefanos Kourtis

Numerically solving multi-marginal optimal transport (MMOT) problems is computationally prohibitive, even for moderate-scale instances involving $l\ge4$ marginals with support sizes of $N\ge1000$. The cost in MMOT is represented as a tensor…

Numerical Analysis · Mathematics 2026-04-03 Chunhui Chen , Jing Chen , Baojia Luo , Shi Jin , Hao Wu

Optimal transport (OT) has gained popularity due to its various applications in fields such as machine learning, statistics, and signal processing. However, the balanced mass requirement limits its performance in practical problems. To…

Machine Learning · Computer Science 2024-04-24 Yikun Bai , Ivan Medri , Rocio Diaz Martin , Rana Muhammad Shahroz Khan , Soheil Kolouri

This paper considers online convex optimization (OCO) with stochastic constraints, which generalizes Zinkevich's OCO over a known simple fixed set by introducing multiple stochastic functional constraints that are i.i.d. generated at each…

Optimization and Control · Mathematics 2017-08-15 Hao Yu , Michael J. Neely , Xiaohan Wei

The Orthogonal Matching Pursuit (OMP) for compressed sensing iterates over a scheme of support augmentation and signal estimation. We present two novel matching pursuit algorithms with intrinsic regularization of the signal estimation step…

Information Theory · Computer Science 2019-02-22 Robert Seidel

Sequential Compressive Sensing, which may be widely used in sensing devices, is a popular topic of recent research. This paper proposes an online recovery algorithm for sparse approximation of sequential compressive sensing. Several…

Information Theory · Computer Science 2013-03-12 Yang You , Jian Jin , Wei Duan , Ningning Liu , Yuantao Gu , Jian Yang

This paper considers online convex optimization over a complicated constraint set, which typically consists of multiple functional constraints and a set constraint. The conventional online projection algorithm (Zinkevich, 2003) can be…

Optimization and Control · Mathematics 2020-05-19 Hao Yu , Michael J. Neely

The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which…

Optimization and Control · Mathematics 2020-10-30 Lenaic Chizat , Pierre Roussillon , Flavien Léger , François-Xavier Vialard , Gabriel Peyré

Motion planning is still an open problem for many disciplines, e.g., robotics, autonomous driving, due to their need for high computational resources that hinder real-time, efficient decision-making. A class of methods striving to provide…

Robotics · Computer Science 2023-10-31 An T. Le , Georgia Chalvatzaki , Armin Biess , Jan Peters