English
Related papers

Related papers: Communication-Efficient Federated Learning with Ad…

200 papers

Communication of model updates between client nodes and the central aggregating server is a major bottleneck in federated learning, especially in bandwidth-limited settings and high-dimensional models. Gradient quantization is an effective…

Machine Learning · Computer Science 2021-02-10 Divyansh Jhunjhunwala , Advait Gadhikar , Gauri Joshi , Yonina C. Eldar

Federated learning (FL) enables geographically dispersed edge devices (i.e., clients) to learn a global model without sharing the local datasets, where each client performs gradient descent with its local data and uploads the gradients to a…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-19 Heting Liu , Fang He , Guohong Cao

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an…

Machine Learning · Computer Science 2020-11-09 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data, but applying FL to multi-modal settings introduces significant challenges. Clients typically possess heterogeneous modalities…

Machine Learning · Computer Science 2026-03-20 Mohamed Badi , Chaouki Ben Issaid , Mehdi Bennis

This paper presents a novel approach to enhance communication efficiency in federated learning through clipped uniform quantization. By leveraging optimal clipping thresholds and client-specific adaptive quantization schemes, the proposed…

Machine Learning · Computer Science 2024-12-17 Zavareh Bozorgasl , Hao Chen

Communication efficiency arises as a necessity in federated learning due to limited communication bandwidth. To this end, the present paper develops an algorithmic framework where an ensemble of pre-trained models is learned. At each…

Machine Learning · Computer Science 2022-03-01 Pouya M Ghari , Yanning Shen

Decentralized federated learning (DFL) is a variant of federated learning, where edge nodes only communicate with their one-hop neighbors to learn the optimal model. However, as information exchange is restricted in a range of one-hop in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-11 Li Chen , Wei Liu , Yunfei Chen , Weidong Wang

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

Machine Learning · Computer Science 2025-10-22 Ali Forootani , Raffaele Iervolino

Distributed and federated learning are essential paradigms for training models across decentralized data sources while preserving privacy, yet communication overhead remains a major bottleneck. This dissertation explores strategies to…

Machine Learning · Computer Science 2025-09-11 Kai Yi

In federated learning (FL), a number of devices train their local models and upload the corresponding parameters or gradients to the base station (BS) to update the global model while protecting their data privacy. However, due to the…

Machine Learning · Computer Science 2022-05-04 Zhigang Yan , Dong Li , Zhichao Zhang , Jiguang He

Federated learning (FL) is a popular paradigm for private and collaborative model training on the edge. In centralized FL, the parameters of a global architecture (such as a deep neural network) are maintained and distributed by a central…

Federated learning has shown its advances over the last few years but is facing many challenges, such as how algorithms save communication resources, how they reduce computational costs, and whether they converge. To address these issues,…

Machine Learning · Computer Science 2022-02-01 Shenglong Zhou , Geoffrey Ye Li