English
Related papers

Related papers: Gradient tracking and variance reduction for decen…

200 papers

The stability and generalization of stochastic gradient-based methods provide valuable insights into understanding the algorithmic performance of machine learning models. As the main workhorse for deep learning, stochastic gradient descent…

Machine Learning · Statistics 2021-02-24 Tao Sun , Dongsheng Li , Bao Wang

Decentralized stochastic optimization has emerged as a fundamental paradigm for large-scale machine learning. However, practical implementations often rely on biased gradient estimators arising from communication compression or inexact…

Optimization and Control · Mathematics 2026-04-10 Qing Xu , Yiwei Liao , Wenqi Fan , Xingxing You , Songyi Dian

This work considers the problem of decentralized online learning, where the goal is to track the optimum of the sum of time-varying functions, distributed across several nodes in a network. The local availability of the functions and their…

Machine Learning · Computer Science 2024-02-14 Shivangi Dubey Sharma , Ketan Rajawat

Minimax optimization problems have attracted significant attention in recent years due to their widespread application in numerous machine learning models. To solve the minimax problem, a wide variety of stochastic optimization methods have…

Machine Learning · Computer Science 2024-06-12 Hongchang Gao

This paper describes a novel algorithmic framework to minimize a finite-sum of functions available over a network of nodes. The proposed framework, that we call~\GTVR, is stochastic and decentralized, and thus is particularly suitable for…

Optimization and Control · Mathematics 2020-12-02 Ran Xin , Usman A. Khan , Soummya Kar

This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes…

Optimization and Control · Mathematics 2024-04-01 Dongyu Han , Kun Liu , Yeming Lin , Yuanqing Xia

Gradient tracking (GT) is an algorithm designed for solving decentralized optimization problems over a network (such as training a machine learning model). A key feature of GT is a tracking mechanism that allows to overcome data…

Optimization and Control · Mathematics 2023-01-05 Yue Liu , Tao Lin , Anastasia Koloskova , Sebastian U. Stich

We consider distributed optimization over networks where each agent is associated with a smooth and strongly convex local objective function. We assume that the agents only have access to unbiased estimators of the gradient of their…

Optimization and Control · Mathematics 2021-10-14 Farzad Yousefian , Jayesh Yevale , Harshal D. Kaushik

To understand the convergence behavior of the Push-Pull method for decentralized optimization with stochastic gradients (Stochastic Push-Pull), this paper presents a comprehensive analysis. Specifically, we first clarify the algorithm's…

Optimization and Control · Mathematics 2025-06-10 Runze You , Shi Pu

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Gradient-tracking (GT) based decentralized methods have emerged as an effective and viable alternative method to decentralized (stochastic) gradient descent (DSGD) when solving distributed online stochastic optimization problems. Initial…

Optimization and Control · Mathematics 2023-01-10 Sulaiman A. Alghunaim , Kun Yuan

Decentralized optimization is a promising parallel computation paradigm for large-scale data analytics and machine learning problems defined over a network of nodes. This paper is concerned with decentralized non-convex composite problems…

Optimization and Control · Mathematics 2021-10-05 Ran Xin , Subhro Das , Usman A. Khan , Soummya Kar

In this paper, we design two compressed decentralized algorithms for solving nonconvex stochastic optimization under two different scenarios. Both algorithms adopt a momentum technique to achieve fast convergence and a message-compression…

Machine Learning · Computer Science 2025-08-08 Wei Liu , Anweshit Panda , Ujwal Pandey , Christopher Brissette , Yikang Shen , George M. Slota , Naigang Wang , Jie Chen , Yangyang Xu

Decentralized stochastic gradient method emerges as a promising solution for solving large-scale machine learning problems. This paper studies the decentralized Markov chain gradient descent (DMGD) algorithm - a variant of the decentralized…

Optimization and Control · Mathematics 2021-04-14 Tao Sun , Dongsheng Li

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

In this paper, we consider the decentralized optimization problems with generalized orthogonality constraints, where both the objective function and the constraint exhibit a distributed structure. Such optimization problems, albeit…

Optimization and Control · Mathematics 2024-09-10 Lei Wang , Nachuan Xiao , Xin Liu

Distributed and federated learning algorithms and techniques associated primarily with minimization problems. However, with the increase of minimax optimization and variational inequality problems in machine learning, the necessity of…

Optimization and Control · Mathematics 2024-06-04 Siqi Zhang , Sayantan Choudhury , Sebastian U Stich , Nicolas Loizou

This paper studies a decentralized stochastic gradient tracking (DSGT) algorithm for non-convex empirical risk minimization problems over a peer-to-peer network of nodes, which is in sharp contrast to the existing DSGT only for convex…

Machine Learning · Computer Science 2020-08-31 Jiaqi Zhang , Keyou You

We consider the task of decentralized minimization of the sum of smooth strongly convex functions stored across the nodes of a network. For this problem, lower bounds on the number of gradient computations and the number of communication…

Optimization and Control · Mathematics 2020-11-16 Dmitry Kovalev , Adil Salim , Peter Richtárik