English
Related papers

Related papers: Revisiting Gradient Staleness: Evaluating Distance…

200 papers

Federated Learning (FL) has emerged as a de facto machine learning area and received rapid increasing research interests from the community. However, catastrophic forgetting caused by data heterogeneity and partial participation poses…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Kangyang Luo , Xiang Li , Yunshi Lan , Ming Gao

Federated learning (FL) enables distributed devices to collaboratively train machine learning models while maintaining data privacy. However, the heterogeneous hardware capabilities of devices often result in significant training delays, as…

Machine Learning · Computer Science 2025-09-23 Letian Zhang , Bo Chen , Jieming Bian , Lei Wang , Jie Xu

Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often faces challenges due to data heterogeneity, leading to…

Machine Learning · Computer Science 2025-10-21 Dun Zeng , Zheshun Wu , Shiyu Liu , Yu Pan , Xiaoying Tang , Zenglin Xu

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

In federated learning, the models can be trained synchronously or asynchronously. Many research works have focused on developing an aggregation method for the server to aggregate multiple local models into the global model with improved…

Machine Learning · Computer Science 2025-10-16 Tien-Dung Cao , Nguyen T. Vuong , Thai Q. Le , Hoang V. N. Dao , Tram Truong-Huu

Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous strategy, putting high communication pressure and model generalization challenge.…

Machine Learning · Computer Science 2021-11-17 Jing Cao , Zirui Lian , Weihong Liu , Zongwei Zhu , Cheng Ji

How to ensure fairness is an important topic in federated learning (FL). Recent studies have investigated how to reward clients based on their contribution (collaboration fairness), and how to achieve uniformity of performance across…

Machine Learning · Computer Science 2023-03-30 Meirui Jiang , Holger R Roth , Wenqi Li , Dong Yang , Can Zhao , Vishwesh Nath , Daguang Xu , Qi Dou , Ziyue Xu

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

Federated learning (FL), as an emerging artificial intelligence (AI) approach, enables decentralized model training across multiple devices without exposing their local training data. FL has been increasingly gaining popularity in both…

Machine Learning · Computer Science 2023-10-23 Victoria Huang , Shaleeza Sohail , Michael Mayo , Tania Lorido Botran , Mark Rodrigues , Chris Anderson , Melanie Ooi

The enormous amount of data produced by mobile and IoT devices has motivated the development of federated learning (FL), a framework allowing such devices (or clients) to collaboratively train machine learning models without sharing their…

Machine Learning · Computer Science 2023-01-12 Angelo Rodio , Francescomaria Faticanti , Othmane Marfoq , Giovanni Neglia , Emilio Leonardi

Federated Learning is a framework that jointly trains a model \textit{with} complete knowledge on a remotely placed centralized server, but \textit{without} the requirement of accessing the data stored in distributed machines. Some work…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Jia Qian , Lars Kai Hansen , Xenofon Fafoutis , Prayag Tiwari , Hari Mohan Pandey

Although federated learning has achieved many breakthroughs recently, the heterogeneous nature of the learning environment greatly limits its performance and hinders its real-world applications. The heterogeneous data, time-varying wireless…

Machine Learning · Computer Science 2023-02-22 Jingxin Li , Toktam Mahmoodi , Hak-Keung Lam

Federated learning has emerged in the last decade as a distributed optimization paradigm due to the rapidly increasing number of portable devices able to support the heavy computational needs related to the training of machine learning…

Machine Learning · Computer Science 2024-10-10 Emanuel Buttaci , Giuseppe Carlo Calafiore

Federated Learning (FL) has emerged as a machine learning approach able to preserve the privacy of user's data. Applying FL, clients train machine learning models on a local dataset and a central server aggregates the learned parameters…

Cryptography and Security · Computer Science 2024-09-27 Luiz Leite , Yuri Santo , Bruno L. Dalmazo , André Riker

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

Machine Learning · Computer Science 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fog-cloud…

Machine Learning · Computer Science 2024-10-28 Van-Dinh Nguyen , Symeon Chatzinotas , Bjorn Ottersten , Trung Q. Duong

Federated learning (FL) enables workers to learn a model collaboratively by using their local data, with the help of a parameter server (PS) for global model aggregation. The high communication cost for periodic model updates and the…

Information Theory · Computer Science 2019-11-04 Yuxuan Sun , Sheng Zhou , Deniz Gündüz

Asynchronous federated learning (AFL) accelerates training by eliminating the need to wait for stragglers, but its asynchronous nature introduces gradient staleness, where outdated gradients degrade performance. Existing solutions address…

Machine Learning · Computer Science 2025-06-24 Chaoyi Lu , Yiding Sun , Jinqian Chen , Zhichuan Yang , Jiangming Pan , Jihua Zhu

The paper considers independent reinforcement learning (IRL) for multi-agent collaborative decision-making in the paradigm of federated learning (FL). However, FL generates excessive communication overheads between agents and a remote…

Machine Learning · Computer Science 2023-05-30 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Federated Learning (FL) revolutionizes collaborative machine learning among Internet of Things (IoT) devices by enabling them to train models collectively while preserving data privacy. FL algorithms fall into two primary categories:…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Liangkun Yu , Xiang Sun , Rana Albelaihi , Chaeeun Park , Sihua Shao