English
Related papers

Related papers: Communication Compression for Decentralized Learni…

200 papers

Decentralized training of deep learning models is a key element for enabling data privacy and on-device learning over networks, as well as for efficient scaling to large compute clusters. As current approaches suffer from limited bandwidth…

Machine Learning · Computer Science 2020-11-12 Anastasia Koloskova , Tao Lin , Sebastian U. Stich , Martin Jaggi

Federated Learning (FL) is an emerging decentralized learning framework through which multiple clients can collaboratively train a learning model. However, a major obstacle that impedes the wide deployment of FL lies in massive…

Machine Learning · Computer Science 2021-05-11 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Yi Pan

This paper focuses on the decentralized optimization problem, where agents in a network cooperate to minimize the sum of their local objective functions by information exchange and local computation. Based on the alternating direction…

Optimization and Control · Mathematics 2023-01-25 Zhen Zhang , Shaofu Yang , Wenying Xu

Two widely considered decentralized learning algorithms are Gossip and random walk-based learning. Gossip algorithms (both synchronous and asynchronous versions) suffer from high communication cost, while random-walk based learning…

Machine Learning · Computer Science 2024-05-14 Peyman Gholami , Hulya Seferoglu

Communication efficiency is a central challenge in distributed machine learning training, and message compression is a widely used solution. However, standard Error Feedback (EF) methods (Seide et al., 2014), though effective for smooth…

Optimization and Control · Mathematics 2025-10-07 Yuan Gao , Anton Rodomanov , Jeremy Rack , Sebastian Stich

Decentralized learning and optimization is a central problem in control that encompasses several existing and emerging applications, such as federated learning. While there exists a vast literature on this topic and most methods centered…

Machine Learning · Computer Science 2023-03-21 Vishnu Pandi Chellapandi , Antesh Upadhyay , Abolfazl Hashemi , Stanislaw H /. Zak

We propose Compressed Vertical Federated Learning (C-VFL) for communication-efficient training on vertically partitioned data. In C-VFL, a server and multiple parties collaboratively train a model on their respective features utilizing…

Machine Learning · Computer Science 2023-03-30 Timothy Castiglia , Anirban Das , Shiqiang Wang , Stacy Patterson

In training of modern large natural language processing (NLP) models, it has become a common practice to split models using 3D parallelism to multiple GPUs. Such technique, however, suffers from a high overhead of inter-node communication.…

Machine Learning · Computer Science 2023-01-25 Jaeyong Song , Jinkyu Yim , Jaewon Jung , Hongsun Jang , Hyung-Jin Kim , Youngsok Kim , Jinho Lee

This paper proposes a novel communication-efficient Split Learning (SL) framework, named Attention-based Double Compression (ADC), which reduces the communication overhead required for transmitting intermediate Vision Transformers…

Machine Learning · Computer Science 2025-09-19 Federico Alvetreti , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

Decentralized learning (DL) is an emerging paradigm of collaborative machine learning that enables nodes in a network to train models collectively without sharing their raw data or relying on a central server. This paper introduces Zip-DL,…

Federated learning (FL) has achieved great success as a privacy-preserving distributed training paradigm, where many edge devices collaboratively train a machine learning model by sharing the model updates instead of the raw data with a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-21 Yuchang Sun , Jiawei Shao , Yuyi Mao , Songze Li , Jun Zhang

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

Continual learning aims to allow models to learn new tasks without forgetting what has been learned before. This work introduces Elastic Variational Continual Learning with Weight Consolidation (EVCL), a novel hybrid model that integrates…

Machine Learning · Computer Science 2024-06-25 Hunar Batra , Ronald Clark

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun

Decentralized training enables learning with distributed datasets generated at different locations without relying on a central server. In realistic scenarios, the data distribution across these sparsely connected learning agents can be…

Machine Learning · Computer Science 2025-02-27 Sakshi Choudhary , Sai Aparna Aketi , Kaushik Roy

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

The increasing complexity of neural networks poses a significant barrier to the deployment of distributed machine learning (ML) on resource-constrained devices, such as federated learning (FL). Split learning (SL) offers a promising…

Machine Learning · Computer Science 2025-08-19 Zehang Lin , Zheng Lin , Miao Yang , Jianhao Huang , Yuxin Zhang , Zihan Fang , Xia Du , Zhe Chen , Shunzhi Zhu , Wei Ni

Communication overhead is one of the major performance bottlenecks in large-scale distributed computing systems, in particular for machine learning applications. Conventionally, compression techniques are used to reduce the load of…

Information Theory · Computer Science 2018-05-08 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Decentralized Federated Learning (DFL) enables collaborative model training without a central server but faces challenges in efficiency, stability, and trustworthiness due to communication and computational limitations among distributed…

Machine Learning · Computer Science 2025-03-18 Shan Sha , Shenglong Zhou , Lingchen Kong , Geoffrey Ye Li

In the last few years, various communication compression techniques have emerged as an indispensable tool helping to alleviate the communication bottleneck in distributed learning. However, despite the fact biased compressors often show…

Machine Learning · Computer Science 2024-01-17 Aleksandr Beznosikov , Samuel Horváth , Peter Richtárik , Mher Safaryan