English
Related papers

Related papers: Efficient Decentralized Deep Learning by Dynamic M…

200 papers

In multiple domains, statistical tasks are performed in distributed settings, with data split among several end machines that are connected to a fusion center. In various applications, the end machines have limited bandwidth and power, and…

Machine Learning · Computer Science 2026-01-05 Rodney Fonseca , Boaz Nadler

This thesis is concerned with distributed control and coordination of networks consisting of multiple, potentially mobile, agents. This is motivated mainly by the emergence of large scale networks characterized by the lack of centralized…

Optimization and Control · Mathematics 2010-10-01 Alex Olshevsky

We introduce a memory- and compute-efficient method for low-communication distributed training. Existing methods reduce communication by performing multiple local updates between infrequent global synchronizations. We demonstrate that their…

Machine Learning · Computer Science 2025-09-29 Anastasiia Filippova , Angelos Katharopoulos , David Grangier , Ronan Collobert

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

Decentralized learning is crucial in supporting on-device learning over large distributed datasets, eliminating the need for a central server. However, the communication overhead remains a major bottleneck for the practical realization of…

Machine Learning · Computer Science 2024-04-10 Sai Aparna Aketi , Abolfazl Hashemi , Kaushik Roy

Decentralized training has been actively studied in recent years. Although a wide variety of methods have been proposed, yet the decentralized momentum SGD method is still underexplored. In this paper, we propose a novel periodic…

Machine Learning · Computer Science 2020-08-25 Hongchang Gao , Heng Huang

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

We consider the problem of decentralized optimization where a collection of agents, each having access to a local cost function, communicate over a time-varying directed network and aim to minimize the sum of those functions. In practice,…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

Semantic communication is a new paradigm that aims at providing more efficient communication for the next-generation wireless network. It focuses on transmitting extracted, meaningful information instead of the raw data. However, deep…

Social and Information Networks · Computer Science 2025-01-09 Yang Li , Xinyu Zhou , Jun Zhao

The Convolutional Neural Network (CNN) model, often used for image classification, requires significant training time to obtain high accuracy. To this end, distributed training is performed with the parameter server (PS) architecture using…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-18 Jay H. Park , Sunghwan Kim , Jinwon Lee , Myeongjae Jeon , Sam H. Noh

The idea of end-to-end learning of communication systems through neural network-based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates…

Information Theory · Computer Science 2019-07-02 Fayçal Ait Aoudia , Jakob Hoydis

Training task in classical machine learning models, such as deep neural networks, is generally implemented at a remote cloud center for centralized learning, which is typically time-consuming and resource-hungry. It also incurs serious…

Machine Learning · Computer Science 2020-10-27 Jinke Ren , Guanding Yu , Guangyao Ding

We study the problem of diffusion-based network learning of a nonlinear phenomenon, $m$, from local agents' measurements collected in a noisy environment. For a decentralized network and information spreading merely between directly…

Machine Learning · Statistics 2023-05-08 Paweł Wachel , Krzysztof Kowalczyk , Cristian R. Rojas

In the last few years, distributed machine learning has been usually executed over heterogeneous networks such as a local area network within a multi-tenant cluster or a wide area network connecting data centers and edge clusters. In these…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-21 Pan Zhou , Qian Lin , Dumitrel Loghin , Beng Chin Ooi , Yuncheng Wu , Hongfang Yu

Decentralized training enables learning with distributed datasets generated at different locations without relying on a central server. In realistic scenarios, the data distribution across these sparsely connected learning agents can be…

Machine Learning · Computer Science 2025-02-27 Sakshi Choudhary , Sai Aparna Aketi , Kaushik Roy

The rapid growth of Internet of Things (IoT) devices has generated vast amounts of data, leading to the emergence of federated learning as a novel distributed machine learning paradigm. Federated learning enables model training at the edge,…

Signal Processing · Electrical Eng. & Systems 2023-11-03 Abdelaziz Salama , Achilleas Stergioulis , Syed Ali Zaidi , Des McLernon

Decentralized learning (DL) offers a powerful framework where nodes collaboratively train models without sharing raw data and without the coordination of a central server. In the iterative rounds of DL, models are trained locally, shared…

Machine Learning · Computer Science 2024-07-02 Akash Dhasade , Paolo Dini , Elia Guerra , Anne-Marie Kermarrec , Marco Miozzo , Rafael Pires , Rishi Sharma , Martijn de Vos

In this paper we consider online distributed learning problems. Online distributed learning refers to the process of training learning models on distributed data sources. In our setting a set of agents need to cooperatively train a learning…

Machine Learning · Computer Science 2024-05-07 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Decentralization is a promising method of scaling up parallel machine learning systems. In this paper, we provide a tight lower bound on the iteration complexity for such methods in a stochastic non-convex setting. Our lower bound reveals a…

Machine Learning · Computer Science 2022-01-31 Yucheng Lu , Christopher De Sa

We study a fully decentralized federated learning algorithm, which is a novel gradient descent algorithm executed on a communication-based network. For convenience, we refer to it as a network gradient descent (NGD) method. In the NGD…

Machine Learning · Computer Science 2022-05-18 Shuyuan Wu , Danyang Huang , Hansheng Wang
‹ Prev 1 4 5 6 7 8 10 Next ›