English
Related papers

Related papers: Bandwidth-Aware and Overlap-Weighted Compression f…

200 papers

Federated learning (FL) enables resource-constrained edge nodes to collaboratively learn a global model under the orchestration of a central server while keeping privacy-sensitive data locally. The…

Machine Learning · Computer Science 2021-04-07 Hongda Wu , Ping Wang

Federated learning (FL) is a new paradigm to train AI models over distributed edge devices (i.e., workers) using their local data, while confronting various challenges including communication resource constraints, edge heterogeneity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-09 Qianpiao Ma , Junlong Zhou , Xiangpeng Hou , Jianchun Liu , Hongli Xu , Jianeng Miao , Qingmin Jia

In Federated Learning, a common approach for aggregating local models across clients is periodic averaging of the full model parameters. It is, however, known that different layers of neural networks can have a different degree of model…

Machine Learning · Computer Science 2022-01-04 Sunwoo Lee , Tuo Zhang , Chaoyang He , Salman Avestimehr

Federated Learning (FL) is a distributed machine learning paradigm that enables learning models from decentralized local data. While FL offers appealing properties for clients' data privacy, it imposes high communication burdens for…

Machine Learning · Computer Science 2023-11-17 Saeed Khalilian , Vasileios Tsouvalas , Tanir Ozcelebi , Nirvana Meratnia

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Federated learning (FL) involves training a model over massive distributed devices, while keeping the training data localized. This form of collaborative learning exposes new tradeoffs among model convergence speed, model accuracy, balance…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-31 Zheng Chai , Yujing Chen , Ali Anwar , Liang Zhao , Yue Cheng , Huzefa Rangwala

Federated learning (FL) learns a model jointly from a set of participating devices without sharing each other's privately held data. The characteristics of non-i.i.d. data across the network, low device participation, high communication…

Machine Learning · Computer Science 2024-01-02 Zhaonan Qu , Kaixiang Lin , Zhaojian Li , Jiayu Zhou , Zhengyuan Zhou

Federated learning (FL) is a decentralized approach, enabling multiple participants to collaboratively train a model while ensuring the protection of data privacy. The transmission of updates from numerous edge clusters to the server…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-20 Haowei Li , Weiying Xie , Hangyu Ye , Jitao Ma , Shuran Ma , Yunsong Li

Communication efficiency is a widely recognised research problem in Federated Learning (FL), with recent work focused on developing techniques for efficient compression, distribution and aggregation of model parameters between clients and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Chamath Palihawadana , Nirmalie Wiratunga , Anjana Wijekoon , Harsha Kalutarage

Cross-device Federated Learning is an increasingly popular machine learning setting to train a model by leveraging a large population of client devices with high privacy and security guarantees. However, communication efficiency remains a…

Machine Learning · Computer Science 2022-07-27 Karthik Prasad , Sayan Ghosh , Graham Cormode , Ilya Mironov , Ashkan Yousefpour , Pierre Stock

Asynchronous Federated Learning (AFL) confronts inherent challenges arising from the heterogeneity of devices (e.g., their computation capacities) and low-bandwidth environments, both potentially causing stale model updates (e.g., local…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Jiajun Song , Jiajun Luo , Rongwei Lu , Shuzhao Xie , Bin Chen , Zhi Wang

Federated learning is a new distributed machine learning framework, where a bunch of heterogeneous clients collaboratively train a model without sharing training data. In this work, we consider a practical and ubiquitous issue when…

Machine Learning · Statistics 2023-09-06 Yikai Yan , Chaoyue Niu , Yucheng Ding , Zhenzhe Zheng , Fan Wu , Guihai Chen , Shaojie Tang , Zhihua Wu

Federated Learning (FL) facilitates collaborative training of a shared global model without exposing clients' private data. In practical FL systems, clients (e.g., edge servers, smartphones, and wearables) typically have disparate system…

Machine Learning · Computer Science 2025-03-03 Leming Shen , Qiang Yang , Kaiyan Cui , Yuanqing Zheng , Xiao-Yong Wei , Jianwei Liu , Jinsong Han

Federated learning is a machine learning training paradigm that enables clients to jointly train models without sharing their own localized data. However, the implementation of federated learning in practice still faces numerous challenges,…

Machine Learning · Computer Science 2023-04-21 Yujia Wang , Lu Lin , Jinghui Chen

The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine…

Machine Learning · Computer Science 2019-02-19 Kai Yang , Tao Jiang , Yuanming Shi , Zhi Ding

Federated Learning (FL) solves many of this decade's concerns regarding data privacy and computation challenges. FL ensures no data leaves its source as the model is trained at where the data resides. However, FL comes with its own set of…

Machine Learning · Computer Science 2021-08-13 Srikanth Chandar , Pravin Chandran , Raghavendra Bhat , Avinash Chakravarthi

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Applying Federated Learning (FL) on Internet-of-Things devices is necessitated by the large volumes of data they produce and growing concerns of data privacy. However, there are three challenges that need to be addressed to make FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-19 Di Wu , Rehmat Ullah , Paul Harvey , Peter Kilpatrick , Ivor Spence , Blesson Varghese

Communication has been known to be one of the primary bottlenecks of federated learning (FL), and yet existing studies have not addressed the efficient communication design, particularly in wireless FL where both uplink and downlink…

Information Theory · Computer Science 2020-12-09 Sihui Zheng , Cong Shen , Xiang Chen