English
Related papers

Related papers: Wyner-Ziv Gradient Compression for Federated Learn…

200 papers

Distributed machine learning has recently become a critical paradigm for training large models on vast datasets. We examine the stochastic optimization problem for deep learning within synchronous parallel computing environments under…

Machine Learning · Computer Science 2024-11-07 Yoni Choukroun , Shlomi Azoulay , Pavel Kisilev

Compression schemes have been extensively used in Federated Learning (FL) to reduce the communication cost of distributed learning. While most approaches rely on a bounded variance assumption of the noise produced by the compressor, this…

Machine Learning · Computer Science 2023-11-01 Mahmoud Hegazy , Rémi Leluc , Cheuk Ting Li , Aymeric Dieuleveut

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

Machine Learning · Computer Science 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

The relay channel, consisting of a source-destination pair and a relay, is a fundamental component of cooperative communications. While the capacity of a general relay channel remains unknown, various relaying strategies, including…

Information Theory · Computer Science 2024-04-24 Ezgi Ozyilkan , Fabrizio Carpi , Siddharth Garg , Elza Erkip

Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices, each with its own local training data set. In this paper, we present a compressive sensing approach for…

Signal Processing · Electrical Eng. & Systems 2020-08-06 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Jun Li , H. Vincent Poor

Federated learning heavily relies on distributed gradient descent techniques. In the situation where gradient information is not available, the gradients need to be estimated from zeroth-order information, which typically involves computing…

Machine Learning · Computer Science 2024-10-25 Chenlin Wu , Xiaoyu He , Zike Li , Jing Gong , Zibin Zheng

Leveraging second-order information about the loss at the scale of deep networks is one of the main lines of approach for improving the performance of current optimizers for deep learning. Yet, existing approaches for accurate full-matrix…

Machine Learning · Computer Science 2024-06-06 Ionut-Vlad Modoranu , Aleksei Kalinov , Eldar Kurtic , Elias Frantar , Dan Alistarh

In distributed training of deep neural networks, people usually run Stochastic Gradient Descent (SGD) or its variants on each machine and communicate with other machines periodically. However, SGD might converge slowly in training some deep…

Machine Learning · Computer Science 2022-10-14 Mingrui Liu , Zhenxun Zhuang , Yunwei Lei , Chunyang Liao

Federated Learning allows distributed entities to train a common model collaboratively without sharing their own data. Although it prevents data collection and aggregation by exchanging only parameter updates, it remains vulnerable to…

Machine Learning · Computer Science 2020-11-12 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

Deep neural networks achieve state-of-the-art and sometimes super-human performance across various domains. However, when learning tasks sequentially, the networks easily forget the knowledge of previous tasks, known as "catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Shixiang Tang , Dapeng Chen , Jinguo Zhu , Shijie Yu , Wanli Ouyang

The exponential growth in model sizes has significantly increased the communication burden in Federated Learning (FL). Existing methods to alleviate this burden by transmitting compressed gradients often face high compression errors, which…

Machine Learning · Computer Science 2025-02-06 Yuhao Zhou , Yuxin Tian , Mingjia Shi , Yuanxi Li , Yanan Sun , Qing Ye , Jiancheng Lv

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated Learning marks a turning point in the implementation of decentralized machine learning (especially deep learning) for wireless devices by protecting users' privacy and safeguarding raw data from third-party access. It assigns the…

We study COMP-AMS, a distributed optimization framework based on gradient averaging and adaptive AMSGrad algorithm. Gradient compression with error feedback is applied to reduce the communication cost in the gradient transmission process.…

Machine Learning · Statistics 2022-05-12 Xiaoyun Li , Belhal Karimi , Ping Li

Coded distributed computation has become common practice for performing gradient descent on large datasets to mitigate stragglers and other faults. This paper proposes a novel algorithm that encodes the partial derivatives themselves and…

Machine Learning · Computer Science 2022-06-22 Pedro Soto , Ilia Ilmer , Haibin Guan , Jun Li

A standard approach in large scale machine learning is distributed stochastic gradient training, which requires the computation of aggregated stochastic gradients over multiple nodes on a network. Communication is a major bottleneck in such…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-24 Hanlin Tang , Xiangru Lian , Chen Yu , Tong Zhang , Ji Liu

Stochastic gradient descent (SGD) is a prevalent optimization technique for large-scale distributed machine learning. While SGD computation can be efficiently divided between multiple machines, communication typically becomes a bottleneck…

Machine Learning · Computer Science 2021-05-24 Dmitrii Avdiukhin , Grigory Yaroslavtsev

In this paper, a novel learning-based Wyner-Ziv coding framework is considered under a distributed image transmission scenario, where the correlated source is only available at the receiver. Unlike other learnable frameworks, our approach…

Information Theory · Computer Science 2025-02-06 Yuxuan Shi , Shuo Shao , Yongpeng Wu , Wenjun Zhang , Merouane Debbah

We analyze the complexity of biased stochastic gradient methods (SGD), where individual updates are corrupted by deterministic, i.e. biased error terms. We derive convergence results for smooth (non-convex) functions and give improved rates…

Machine Learning · Computer Science 2021-05-11 Ahmad Ajalloeian , Sebastian U. Stich

Although the distributed machine learning methods can speed up the training of large deep neural networks, the communication cost has become the non-negligible bottleneck to constrain the performance. To address this challenge, the gradient…

Machine Learning · Computer Science 2022-01-25 An Xu , Zhouyuan Huo , Heng Huang