English
Related papers

Related papers: Wyner-Ziv Gradient Compression for Federated Learn…

200 papers

Federated learning (FL) enables multiple devices to collaboratively learn a global model without sharing their personal data. In real-world applications, the different parties are likely to have heterogeneous data distribution and limited…

Machine Learning · Computer Science 2021-11-23 Ouiame Marnissi , Hajar El Hammouti , El Houcine Bergou

Sign-based algorithms (e.g. signSGD) have been proposed as a biased gradient compression technique to alleviate the communication bottleneck in training large neural networks across multiple workers. We show simple convex counter-examples…

Machine Learning · Computer Science 2019-05-30 Sai Praneeth Karimireddy , Quentin Rebjock , Sebastian U. Stich , Martin Jaggi

In federated learning (FL), a global model is trained at a Parameter Server (PS) by aggregating model updates obtained from multiple remote learners. Generally, the communication between the remote users and the PS is rate-limited, while…

Machine Learning · Computer Science 2022-06-06 Sadaf Salehkalaibar , Stefano Rini

Decentralized stochastic gradient descent (SGD) is a driving engine for decentralized federated learning (DFL). The performance of decentralized SGD is jointly influenced by inter-node communications and local updates. In this paper, we…

Machine Learning · Computer Science 2022-02-14 Wei Liu , Li Chen , Wenyi Zhang

This paper deals with distributed optimization problems that use compressed communication to achieve efficient performance and mitigate communication bottleneck. We propose a family of compression schemes in which operators transform…

Optimization and Control · Mathematics 2026-01-13 Andrey Veprikov , Vladimir Solodkin , Mikhail Rudakov , Petr Babkin , Aleksandr Beznosikov

This paper investigates the privacy-preserving distributed optimization problem, aiming to protect agents' private information from potential attackers during the optimization process. Gradient tracking, an advanced technique for improving…

Machine Learning · Computer Science 2025-09-24 Furan Xie , Bing Liu , Li Chai

Federated Learning (FL) is a distributed learning paradigm that enhances users privacy by eliminating the need for clients to share raw, private data with the server. Despite the success, recent studies expose the vulnerability of FL to…

Machine Learning · Computer Science 2023-12-15 Jing Wu , Munawar Hayat , Mingyi Zhou , Mehrtash Harandi

Existing high-performance deep learning models require very intensive computing. For this reason, it is difficult to embed a deep learning model into a system with limited resources. In this paper, we propose the novel idea of the network…

Machine Learning · Computer Science 2019-02-13 Dae-Woong Jeong , Jaehun Kim , Youngseok Kim , Tae-Ho Kim , Myungsu Chae

Compression is an efficient way to relieve the tremendous communication overhead of federated learning (FL) systems. However, for the existing works, the information loss under compression will lead to unexpected model/gradient deviation…

Machine Learning · Computer Science 2024-12-31 Jiaming Yan , Jianchun Liu , Hongli Xu , Liusheng Huang , Jiantao Gong , Xudong Liu , Kun Hou

News recommendation is critical for personalized news access. Most existing news recommendation methods rely on centralized storage of users' historical news click behavior data, which may lead to privacy concerns and hazards. Federated…

Information Retrieval · Computer Science 2023-05-31 Jingwei Yi , Fangzhao Wu , Chuhan Wu , Ruixuan Liu , Guangzhong Sun , Xing Xie

Distributed synchronous stochastic gradient descent has been widely used to train deep neural networks (DNNs) on computer clusters. With the increase of computational power, network communications generally limit the system scalability.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-19 Shaohuai Shi , Xiaowen Chu , Bo Li

With the increasing scale of machine learning tasks, it has become essential to reduce the communication between computing nodes. Early work on gradient compression focused on the bottleneck between CPUs and GPUs, but…

Optimization and Control · Mathematics 2020-06-18 Sarit Khirirat , Sindri Magnússon , Arda Aytekin , Mikael Johansson

Due to the high communication cost in distributed and federated learning, methods relying on compressed communication are becoming increasingly popular. Besides, the best theoretically and practically performing gradient-type methods…

Machine Learning · Computer Science 2021-11-09 Zhize Li , Peter Richtárik

Gradient compression (GC) is a promising approach to addressing the communication bottleneck in distributed deep learning (DDL). However, it is challenging to find the optimal compression strategy for applying GC to DDL because of the…

Machine Learning · Computer Science 2022-06-08 Zhuang Wang , Haibin Lin , Yibo Zhu , T. S. Eugene Ng

Gradient compression is a widely-established remedy to tackle the communication bottleneck in distributed training of large deep neural networks (DNNs). Under the error-feedback framework, Top-$k$ sparsification, sometimes with $k$ as…

Machine Learning · Computer Science 2021-08-03 Atal Narayan Sahu , Aritra Dutta , Ahmed M. Abdelmoniem , Trambak Banerjee , Marco Canini , Panos Kalnis

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as…

Machine Learning · Computer Science 2017-10-31 Jianqiao Wangni , Jialei Wang , Ji Liu , Tong Zhang

In federated learning, communication cost can be significantly reduced by transmitting the information over the air through physical channels. In this paper, we propose a new class of adaptive federated stochastic gradient descent (SGD)…

Machine Learning · Computer Science 2025-09-03 Rui Zhang , Wenlong Mou

Gradient inversion attack enables recovery of training samples from model gradients in federated learning (FL), and constitutes a serious threat to data privacy. To mitigate this vulnerability, prior work proposed both principled defenses…

Machine Learning · Computer Science 2023-06-13 Ruihan Wu , Xiangyu Chen , Chuan Guo , Kilian Q. Weinberger

Gradient tracking methods have emerged as one of the most popular approaches for solving decentralized optimization problems over networks. In this setting, each node in the network has a portion of the global objective function, and the…

Optimization and Control · Mathematics 2023-11-27 Albert S. Berahas , Raghu Bollapragada , Shagun Gupta

In this paper, we propose a method of distributed stochastic gradient descent (SGD), with low communication load and computational complexity, and still fast convergence. To reduce the communication load, at each iteration of the algorithm,…

Machine Learning · Computer Science 2020-03-30 Naeimeh Omidvar , Mohammad Ali Maddah-Ali , Hamed Mahdavi