English
Related papers

Related papers: Accelerating Gossip SGD with Periodic Global Avera…

200 papers

Distributed deep learning is an effective way to reduce the training time of deep learning for large datasets as well as complex models. However, the limited scalability caused by network overheads makes it difficult to synchronize the…

Machine Learning · Computer Science 2022-10-18 Sangho Yeo , Minho Bae , Minjoong Jeong , Oh-kyoung Kwon , Sangyoon Oh

We consider the decentralized stochastic optimization problems, where a network of $n$ nodes, each owning a local cost function, cooperate to find a minimizer of the globally-averaged cost. A widely studied decentralized algorithm for this…

Optimization and Control · Mathematics 2022-03-04 Kun Yuan , Sulaiman A. Alghunaim , Xinmeng Huang

Distributing Neural Network training is of particular interest for several reasons including scaling using computing clusters, training at data sources such as IOT devices and edge servers, utilizing underutilized resources across…

Machine Learning · Computer Science 2018-12-07 Siddharth Pramod

Decentralized optimization algorithms have recently attracted increasing attention due to its wide applications in all areas of science and engineering. In these algorithms, a collection of agents collaborate to minimize the average of a…

Optimization and Control · Mathematics 2024-09-18 Shujing Feng , Xin Jiang

We address the issue of speeding up the training of convolutional networks. Here we study a distributed method adapted to stochastic gradient descent (SGD). The parallel optimization setup uses several threads, each applying individual…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Michael Blot , David Picard , Matthieu Cord , Nicolas Thome

We consider speeding up stochastic gradient descent (SGD) by parallelizing it across multiple workers. We assume the same data set is shared among $N$ workers, who can take SGD steps and coordinate with a central server. While it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-28 Artin Spiridonoff , Alex Olshevsky , Ioannis Ch. Paschalidis

In this paper, we present GossipGraD - a gossip communication protocol based Stochastic Gradient Descent (SGD) algorithm for scaling Deep Learning (DL) algorithms on large-scale systems. The salient features of GossipGraD are: 1) reduction…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-16 Jeff Daily , Abhinav Vishnu , Charles Siegel , Thomas Warfel , Vinay Amatya

Gossip algorithms for distributed computation are attractive due to their simplicity, distributed nature, and robustness in noisy and uncertain environments. However, using standard gossip algorithms can lead to a significant waste in…

Information Theory · Computer Science 2009-11-13 Alexandros G. Dimakis , Anand D. Sarwate , Martin J. Wainwright

Federated Learning is a popular approach for distributed learning due to its security and computational benefits. With the advent of powerful devices in the network edge, Gossip Learning further decentralizes Federated Learning by removing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-02 Tom Goethals , Merlijn Sebrechts , Stijn De Schrijver , Filip De Turck , Bruno Volckaert

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual…

Machine Learning · Computer Science 2018-11-13 Michael Blot , David Picard , Matthieu Cord

We consider speeding up stochastic gradient descent (SGD) by parallelizing it across multiple workers. We assume the same data set is shared among $n$ workers, who can take SGD steps and coordinate with a central server. Unfortunately, this…

Optimization and Control · Mathematics 2020-06-05 Artin Spiridonoff , Alex Olshevsky , Ioannis Ch. Paschalidis

Stochastic Gradient Descent (SGD) is the key learning algorithm for many machine learning tasks. Because of its computational costs, there is a growing interest in accelerating SGD on HPC resources like GPU clusters. However, the…

Machine Learning · Computer Science 2021-01-20 Peng Jiang , Gagan Agrawal

Gossip algorithms for aggregation have recently received significant attention for sensor network applications because of their simplicity and robustness in noisy and uncertain environments. However, gossip algorithms can waste significant…

Information Theory · Computer Science 2007-07-13 Alexandros G. Dimakis , Anand D. Sarwate , Martin J. Wainwright

We consider decentralized stochastic optimization with the objective function (e.g. data samples for machine learning task) being distributed over $n$ machines that can only communicate to their neighbors on a fixed communication graph. To…

Machine Learning · Computer Science 2019-02-04 Anastasia Koloskova , Sebastian U. Stich , Martin Jaggi

This paper investigates the problem of distributed network-wide averaging and proposes a new greedy gossip algorithm. Instead of finding the optimal path of each node in a greedy manner, the proposed approach utilises a suboptimal…

Systems and Control · Computer Science 2019-08-20 Hyo-Sang Shin , Shaoming He , Antonios Tsourdos

Training time on large datasets for deep neural networks is the principal workflow bottleneck in a number of important applications of deep learning, such as object classification and detection in automatic driver assistance systems (ADAS).…

Machine Learning · Computer Science 2016-11-15 Peter H. Jin , Qiaochu Yuan , Forrest Iandola , Kurt Keutzer

We focus on the well-studied problem of distributed overlay network construction. We consider a synchronous gossip-based communication model where in each round a node can send a message of small size to another node whose identifier it…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Fabien Dufoulon , Michael Moorman , William K. Moses , Gopal Pandurangan

Distributed parallel stochastic gradient descent algorithms are workhorses for large scale machine learning tasks. Among them, local stochastic gradient descent (Local SGD) has attracted significant attention due to its low communication…

Machine Learning · Computer Science 2020-12-16 Shuheng Shen , Yifei Cheng , Jingchang Liu , Linli Xu

In recent times, a considerable amount of work has been devoted to the development and analysis of gossip algorithms in Geometric Random Graphs. In a recently introduced model termed "Geographic Gossip," each node is aware of its position…

Multiagent Systems · Computer Science 2007-07-16 Hariharan Narayanan

This paper presents greedy gossip with eavesdropping (GGE), a novel randomized gossip algorithm for distributed computation of the average consensus problem. In gossip algorithms, nodes in the network randomly communicate with their…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-14 Deniz Ustebay , Boris Oreshkin , Mark Coates , Michael Rabbat
‹ Prev 1 2 3 10 Next ›