English
Related papers

Related papers: Adaptive Quantization of Model Updates for Communi…

200 papers

Training a machine learning model with federated edge learning (FEEL) is typically time-consuming due to the constrained computation power of edge devices and limited wireless resources in edge networks. In this paper, the training time…

Information Theory · Computer Science 2022-01-03 Peixi Liu , Jiamo Jiang , Guangxu Zhu , Lei Cheng , Wei Jiang , Wu Luo , Ying Du , Zhiqin Wang

Federated Learning (FL) enables decentralized model training across multiple clients while optionally preserving data privacy. However, communication efficiency remains a critical bottleneck, particularly for large-scale models. In this…

Machine Learning · Computer Science 2025-11-11 Arnaud Descours , Léonard Deroose , Jan Ramon

The present paper develops a novel aggregated gradient approach for distributed machine learning that adaptively compresses the gradient communication. The key idea is to first quantize the computed gradients, and then skip less informative…

Machine Learning · Computer Science 2019-09-18 Jun Sun , Tianyi Chen , Georgios B. Giannakis , Zaiyue Yang

Federated learning (FL) is a distributed learning framework where users train a global model by exchanging local model updates with a server instead of raw datasets, preserving data privacy and reducing communication overhead. However, the…

Machine Learning · Computer Science 2024-12-17 Afsaneh Mahmoudi , Emil Björnson

One of the most significant bottleneck in training large scale machine learning models on parameter server (PS) is the communication overhead, because it needs to frequently exchange the model gradients between the workers and servers…

Machine Learning · Computer Science 2018-04-25 Guoxin Cui , Jun Xu , Wei Zeng , Yanyan Lan , Jiafeng Guo , Xueqi Cheng

Federated Learning (FL) can protect the privacy of the vehicles in vehicle edge computing (VEC) to a certain extent through sharing the gradients of vehicles' local models instead of local data. The gradients of vehicles' local models are…

Machine Learning · Computer Science 2025-06-19 Cui Zhang , Wenjun Zhang , Qiong Wu , Pingyi Fan , Qiang Fan , Jiangzhou Wang , Khaled B. Letaief

Communication has been known to be one of the primary bottlenecks of federated learning (FL), and yet existing studies have not addressed the efficient communication design, particularly in wireless FL where both uplink and downlink…

Information Theory · Computer Science 2020-12-09 Sihui Zheng , Cong Shen , Xiang Chen

Federated Learning (FL) enables privacy-preserving intelligence on Internet of Things (IoT) devices but incurs a significant carbon footprint due to the high energy cost of frequent uplink transmission. While pre-trained models are…

Machine Learning · Computer Science 2026-03-19 Charuka Herath , Yogachandran Rahulamathavan , Varuna De Silva , Sangarapillai Lambotharan

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Asynchronous Federated Learning (AFL) confronts inherent challenges arising from the heterogeneity of devices (e.g., their computation capacities) and low-bandwidth environments, both potentially causing stale model updates (e.g., local…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Jiajun Song , Jiajun Luo , Rongwei Lu , Shuzhao Xie , Bin Chen , Zhi Wang

Quantum federated learning (QFL) is a quantum extension of the classical federated learning model across multiple local quantum devices. An efficient optimization algorithm is always expected to minimize the communication overhead among…

Quantum Physics · Physics 2023-03-15 Jun Qi , Xiao-Lei Zhang , Javier Tejedor

Federated learning (FL) has emerged as a distributed machine learning (ML) technique that can protect local data privacy for participating clients and improve system efficiency. Instead of sharing raw data, FL exchanges intermediate…

Information Theory · Computer Science 2025-08-26 Xiang Ma , Haijian Sun , Rose Qingyang Hu , Yi Qian

Federated Learning (FL) has achieved significant achievements recently, enabling collaborative model training on distributed data over edge devices. Iterative gradient or model exchanges between devices and the centralized server in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-19 Ji Liu , Tianshi Che , Yang Zhou , Ruoming Jin , Huaiyu Dai , Dejing Dou , Patrick Valduriez

Mixed Precision Quantization (MPQ) has become an essential technique for optimizing neural network by determining the optimal bitwidth per layer. Existing MPQ methods, however, face a major hurdle: they require a computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Lianbo Ma , Jianlun Ma , Yuee Zhou , Guoyang Xie , Qiang He , Zhichao Lu

Decentralized Federated Learning (DFL) trains models in a collaborative and privacy-preserving manner while removing model centralization risks and improving communication bottlenecks. However, DFL faces challenges in efficient…

Federated Learning (FL) is a promising privacy-preserving distributed learning framework where a server aggregates models updated by multiple devices without accessing their private datasets. Hierarchical FL (HFL), as a device-edge-cloud…

Machine Learning · Computer Science 2023-05-17 Xiaonan Liu , Shiqiang Wang , Yansha Deng , Arumugam Nallanathan

AI-driven medical diagnostics increasingly requires collaborative model training across institutions, yet centralizing patient data conflicts with privacy regulations. Federated Learning enables distributed training without raw data…

Quantum Physics · Physics 2026-05-13 Suzukaze Kamei , Hideaki Kawaguchi , Takahiko Satoh

Asynchronous Federated Learning with Buffered Aggregation (FedBuff) is a state-of-the-art algorithm known for its efficiency and high scalability. However, it has a high communication cost, which has not been examined with quantized…

Machine Learning · Computer Science 2023-08-02 Tomas Ortega , Hamid Jafarkhani

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

Machine Learning · Computer Science 2025-10-22 Ali Forootani , Raffaele Iervolino

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh