English
Related papers

Related papers: Inexact Bregman Sparse Newton Method for Efficient…

200 papers

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

Optimal transport (OT) and unbalanced optimal transport (UOT) are central in many machine learning, statistics and engineering applications. 1D OT is easily solved, with complexity O(n log n), but no efficient algorithm was known for 1D…

Performance · Computer Science 2024-02-15 Gabriel Gouvine

An inexact Newton type method for numerical minimization of convex piecewise quadratic functions is considered and its convergence is analyzed. Earlier, a similar method was successfully applied to optimizaton problems arising in numerical…

Optimization and Control · Mathematics 2019-01-11 Alexander I. Golikov , Igor E. Kaporin

In this paper, we propose an inexact perturbed path-following algorithm in the framework of Lagrangian dual decomposition for solving large-scale structured convex optimization problems. Unlike the exact versions considered in literature,…

Optimization and Control · Mathematics 2011-09-16 Quoc Tran Dinh , Ion Necoara , Carlo Savorgnan , Moritz Diehl

In this paper, we propose an accelerated version for the Sinkhorn algorithm, which is the reference method for computing the solution to Entropic Optimal Transport. Its main draw-back is the exponential slow-down of convergence as the…

Numerical Analysis · Mathematics 2025-06-19 Reda Chhaibi , Serge Gratton , Samuel Vaiter

Optimal Transport is a useful metric to compare probability distributions and to compute a pairing given a ground cost. Its entropic regularization variant (eOT) is crucial to have fast algorithms and reflect fuzzy/noisy matchings. This…

Statistics Theory · Mathematics 2024-03-12 Francisco Andrade , Gabriel Peyre , Clarice Poon

Despite the recent popularity of neural network-based solvers for optimal transport (OT), there is no standard quantitative way to evaluate their performance. In this paper, we address this issue for quadratic-cost transport --…

Machine Learning · Computer Science 2021-10-26 Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Alexander Filippov , Evgeny Burnaev

Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes…

Machine Learning · Computer Science 2024-06-21 Gen Li , Yanxi Chen , Yu Huang , Yuejie Chi , H. Vincent Poor , Yuxin Chen

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

Data Structures and Algorithms · Computer Science 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

Solving large scale Optimal Transport (OT) in machine learning typically relies on sampling measures to obtain a tractable discrete problem. While the discrete solver's accuracy is controllable, the rate of convergence of the discretization…

Machine Learning · Statistics 2026-02-05 Ferdinand Genans , Olivier Wintenberger

This paper discusses the efficiency of Hybrid Primal-Dual (HPD) type algorithms to approximate solve discrete Optimal Transport (OT) and Wasserstein Barycenter (WB) problems, with and without entropic regularization. Our first contribution…

Optimization and Control · Mathematics 2022-09-01 Antonin Chambolle , Juan Pablo Contreras

Optimal Transport is a popular distance metric for measuring similarity between distributions. Exact algorithms for computing Optimal Transport can be slow, which has motivated the development of approximate numerical solvers (e.g. Sinkhorn…

Machine Learning · Computer Science 2022-03-09 Nathaniel Lahn , Sharath Raghvendra , Kaiyi Zhang

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

We analyze two algorithms for approximating the general optimal transport (OT) distance between two discrete distributions of size $n$, up to accuracy $\varepsilon$. For the first algorithm, which is based on the celebrated Sinkhorn's…

Data Structures and Algorithms · Computer Science 2018-06-08 Pavel Dvurechensky , Alexander Gasnikov , Alexey Kroshnin

Adapted optimal transport (AOT) problems are optimal transport problems for distributions of a time series where couplings are constrained to have a temporal causal structure. In this paper, we develop computational tools for solving AOT…

Probability · Mathematics 2023-04-26 Stephan Eckstein , Gudmund Pammer

We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes $(\delta,L)$ inexact oracle and…

Given a $d$-dimensional continuous (resp. discrete) probability distribution $\mu$ and a discrete distribution $\nu$, the semi-discrete (resp. discrete) Optimal Transport (OT) problem asks for computing a minimum-cost plan to transport mass…

Computational Geometry · Computer Science 2023-11-07 Pankaj K. Agarwal , Sharath Raghvendra , Pouyan Shirzadian , Keegan Yao

We consider the task of designing sparse control laws for large-scale systems by directly minimizing an infinite horizon quadratic cost with an $\ell_1$ penalty on the feedback controller gains. Our focus is on an improved algorithm that…

Optimization and Control · Mathematics 2013-12-18 Matt Wytock , J. Zico Kolter

The sparse nonlinear programming (SNP) problem has wide applications in signal and image processing, machine learning, pattern recognition, finance and management, etc. However, the computational challenge posed by SNP has not yet been well…

Optimization and Control · Mathematics 2021-05-26 Chen Zhao , Naihua Xiu , Hou-Duo Qi , Ziyan Luo

We propose a novel approach based on optimal transport (OT) for tackling the problem of highly mixed data in blind hyperspectral unmixing. Our method constrains the distribution of the estimated abundance matrix to resemble a targeted…

Image and Video Processing · Electrical Eng. & Systems 2025-09-26 D. Doutsas , B. Figliuzzi