English
Related papers

Related papers: An Accelerated Stochastic Algorithm for Solving th…

200 papers

We analyze two algorithms for approximating the general optimal transport (OT) distance between two discrete distributions of size $n$, up to accuracy $\varepsilon$. For the first algorithm, which is based on the celebrated Sinkhorn's…

Data Structures and Algorithms · Computer Science 2018-06-08 Pavel Dvurechensky , Alexander Gasnikov , Alexey Kroshnin

This paper improves the state-of-the-art rate of a first-order algorithm for solving entropy regularized optimal transport. The resulting rate for approximating the optimal transport (OT) has been improved from…

Optimization and Control · Mathematics 2023-01-25 Yiling Luo , Yiling Xie , Xiaoming Huo

We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance over state-of-art primal-dual…

Data Structures and Algorithms · Computer Science 2020-06-16 Wenshuo Guo , Nhat Ho , Michael I. Jordan

We present several new complexity results for the entropic regularized algorithms that approximately solve the optimal transport (OT) problem between two discrete probability measures with at most $n$ atoms. First, we improve the complexity…

Data Structures and Algorithms · Computer Science 2022-05-19 Tianyi Lin , Nhat Ho , Michael I. Jordan

Optimal transport (OT) defines a powerful framework to compare probability distributions in a geometrically faithful way. However, the practical impact of OT is still limited because of its computational burden. We propose a new class of…

Optimization and Control · Mathematics 2016-05-30 Genevay Aude , Marco Cuturi , Gabriel Peyré , Francis Bach

We provide theoretical analyses for two algorithms that solve the regularized optimal transport (OT) problem between two discrete probability measures with at most $n$ atoms. We show that a greedy variant of the classical Sinkhorn…

Data Structures and Algorithms · Computer Science 2021-07-27 Tianyi Lin , Nhat Ho , Michael I. Jordan

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

Optimization and Control · Mathematics 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson

The optimal transport (OT) problem is a classical optimization problem having the form of linear programming. Machine learning applications put forward new computational challenges in its solution. In particular, the OT problem defines a…

Optimization and Control · Mathematics 2022-10-25 Nazarii Tupitsa , Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov

One of the most widely used methods for solving large-scale stochastic optimization problems is distributed asynchronous stochastic gradient descent (DASGD), a family of algorithms that result from parallelizing stochastic gradient descent…

Optimization and Control · Mathematics 2021-07-08 Zhengyuan Zhou , Panayotis Mertikopoulos , Nicholas Bambos , Peter W. Glynn , Yinyu Ye

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

Numerical Analysis · Mathematics 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

In this paper, we propose a practical primal-dual algorithm with theoretical guarantees and develop a GPU-based solver, which we dub PDOT, for solving large-scale optimal transport problems. Compared to Sinkhorn algorithm or classic LP…

Optimization and Control · Mathematics 2024-07-30 Haihao Lu , Jinwen Yang

This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent~(SGD) equipped with "powerball" method to accelerate. We…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Colleen P. Bailey

The alternating gradient descent (AGD) is a simple but popular algorithm which has been applied to problems in optimization, machine learning, data ming, and signal processing, etc. The algorithm updates two blocks of variables in an…

Optimization and Control · Mathematics 2018-03-01 Songtao Lu , Mingyi Hong , Zhengdao Wang

Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is…

Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes…

Machine Learning · Computer Science 2024-06-21 Gen Li , Yanxi Chen , Yu Huang , Yuejie Chi , H. Vincent Poor , Yuxin Chen

We analyze stochastic gradient algorithms for optimizing nonconvex problems. In particular, our goal is to find local minima (second-order stationary points) instead of just finding first-order stationary points which may be some bad…

Machine Learning · Computer Science 2019-06-24 Zhize Li

Optimal transportation, or computing the Wasserstein or ``earth mover's'' distance between two distributions, is a fundamental primitive which arises in many learning and statistical settings. We give an algorithm which solves this problem…

Data Structures and Algorithms · Computer Science 2019-06-04 Arun Jambulapati , Aaron Sidford , Kevin Tian

The all-pairs shortest distances (APSD) with differential privacy (DP) problem takes as input an undirected, weighted graph $G = (V,E, \mathbf{w})$ and outputs a private estimate of the shortest distances in $G$ between all pairs of…

Data Structures and Algorithms · Computer Science 2024-07-16 Jesse Campbell , Chunjiang Zhu

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai
‹ Prev 1 2 3 10 Next ›