English
Related papers

Related papers: Multi-Level Local SGD for Heterogeneous Hierarchic…

200 papers

We design a low complexity decentralized learning algorithm to train a recently proposed large neural network in distributed processing nodes (workers). We assume the communication network between the workers is synchronized and can be…

Machine Learning · Computer Science 2020-09-30 Xinyue Liang , Alireza M. Javid , Mikael Skoglund , Saikat Chatterjee

A variant of consensus based distributed gradient descent (\textbf{DGD}) is studied for finite sums of smooth but possibly non-convex functions. In particular, the local gradient term in the fixed step-size iteration of each agent is…

Optimization and Control · Mathematics 2026-05-27 Lei Qin , Michael Cantoni , Ye Pu

Communication overhead is one of the key challenges that hinders the scalability of distributed optimization algorithms. In this paper, we study local distributed SGD, where data is partitioned among computation nodes, and the computation…

Machine Learning · Computer Science 2020-05-15 Farzin Haddadpour , Mohammad Mahdi Kamani , Mehrdad Mahdavi , Viveck R. Cadambe

This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes…

Optimization and Control · Mathematics 2024-04-01 Dongyu Han , Kun Liu , Yeming Lin , Yuanqing Xia

Despite the non-convex optimization landscape, over-parametrized shallow networks are able to achieve global convergence under gradient descent. The picture can be radically different for narrow networks, which tend to get stuck in…

Machine Learning · Statistics 2023-06-16 Rodrigo Veiga , Ludovic Stephan , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

This paper considers the distributed optimization of a sum of locally observable, non-convex functions. The optimization is performed over a multi-agent networked system, and each local function depends only on a subset of the variables. An…

Optimization and Control · Mathematics 2016-05-04 Sandeep Kumar , Rahul Jain , Ketan Rajawat

Consensus-based decentralized stochastic gradient descent (D-SGD) is a widely adopted algorithm for decentralized training of machine learning models across networked agents. A crucial part of D-SGD is the consensus-based model averaging,…

Information Theory · Computer Science 2025-02-12 Daniel Pérez Herrera , Zheng Chen , Erik G. Larsson

This study investigates leveraging stochastic gradient descent (SGD) to learn operators between general Hilbert spaces. We propose weak and strong regularity conditions for the target operator to depict its intrinsic structure and…

Machine Learning · Statistics 2026-01-13 Lei Shi , Jia-Qi Yang

Stochastic gradient descent (SGD) has been a go-to algorithm for nonconvex stochastic optimization problems arising in machine learning. Its theory however often requires a strong framework to guarantee convergence properties. We hereby…

Optimization and Control · Mathematics 2025-03-11 Azar Louzi

Large neural network models present a hefty communication challenge to distributed Stochastic Gradient Descent (SGD), with a communication complexity of O(n) per worker for a model of n parameters. Many sparsification and quantization…

Machine Learning · Computer Science 2020-06-17 Subhadeep Bhattacharya , Weikuan Yu , Fahim Tahmid Chowdhury

This work centers on the communication aspects of decentralized learning over wireless networks, using consensus-based decentralized stochastic gradient descent (D-SGD). Considering the actual communication cost or delay caused by…

Machine Learning · Computer Science 2023-10-26 Daniel Pérez Herrera , Zheng Chen , Erik G. Larsson

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Ying Sun , Gesualdo Scutari , Daniel Palomar

This paper develops algorithms for decentralized machine learning over a network, where data are distributed, computation is localized, and communication is restricted between neighbors. A line of recent research in this area focuses on…

Optimization and Control · Mathematics 2020-08-06 Yanli Liu , Yuejiao Sun , Wotao Yin

As human-robot collaboration increases in the workforce, it becomes essential for human-robot teams to coordinate efficiently and intuitively. Traditional approaches for human-robot scheduling either utilize exact methods that are…

Artificial Intelligence · Computer Science 2023-02-01 Batuhan Altundas , Zheyuan Wang , Joshua Bishop , Matthew Gombolay

This paper presents a comprehensive study on the convergence rates of the stochastic gradient descent (SGD) algorithm when applied to overparameterized two-layer neural networks. Our approach combines the Neural Tangent Kernel (NTK)…

Machine Learning · Statistics 2024-07-11 Dinghao Cao , Zheng-Chu Guo , Lei Shi

We consider a multi agent optimization problem where a set of agents collectively solves a global optimization problem with the objective function given by the sum of locally known convex functions. We focus on the case when information…

Optimization and Control · Mathematics 2016-03-14 Ali Makhdoumi , Asuman Ozdaglar

There is significant recent interest to parallelize deep learning algorithms in order to handle the enormous growth in data and model sizes. While most advances focus on model parallelization and engaging multiple computing agents via using…

Machine Learning · Statistics 2017-06-27 Zhanhong Jiang , Aditya Balu , Chinmay Hegde , Soumik Sarkar

Stochastic gradient descent (SGD) is an essential element in Machine Learning (ML) algorithms. Asynchronous parallel shared-memory SGD (AsyncSGD), including synchronization-free algorithms, e.g. HOGWILD!, have received interest in certain…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-19 Karl Bäckström , Ivan Walulya , Marina Papatriantafilou , Philippas Tsigas

We study strongly convex distributed optimization problems where a set of agents are interested in solving a separable optimization problem collaboratively. In this paper, we propose and study a two time-scale decentralized gradient descent…

Optimization and Control · Mathematics 2022-08-16 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer