English
Related papers

Related papers: Sparse Training for Federated Learning with Regula…

200 papers

Federated Learning (FL) represents a paradigm shift in the field of machine learning, offering an approach for a decentralized training of models across a multitude of devices while maintaining the privacy of local data. However, the…

Machine Learning · Computer Science 2024-08-21 Tatjana Legler , Vinit Hegiste , Martin Ruskowski

In federated learning (FL), a machine learning (ML) model is collectively trained by a large number of users, using their private data in their local devices. With top $r$ sparsification in FL, the users only upload the most significant $r$…

Information Theory · Computer Science 2023-03-08 Sajani Vithana , Sennur Ulukus

Decentralized Federated Learning (DFL) has become popular due to its robustness and avoidance of centralized coordination. In this paradigm, clients actively engage in training by exchanging models with their networked neighbors. However,…

Machine Learning · Computer Science 2024-07-24 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Edge devices can benefit remarkably from federated learning due to their distributed nature; however, their limited resource and computing power poses limitations in deployment. A possible solution to this problem is to utilize…

Machine Learning · Computer Science 2023-10-26 Sara Babakniya , Souvik Kundu , Saurav Prakash , Yue Niu , Salman Avestimehr

Federated learning (FL) has emerged as a new paradigm for privacy-preserving collaborative training. Under domain skew, the current FL approaches are biased and face two fairness problems. 1) Parameter Update Conflict: data disparity among…

Machine Learning · Computer Science 2024-05-28 Yuhang Chen , Wenke Huang , Mang Ye

Federated learning (FL) enables multiple clients with distributed data sources to collaboratively train a shared model without compromising data privacy. However, existing FL paradigms face challenges due to heterogeneity in client data…

Machine Learning · Computer Science 2024-10-21 Brianna Mueller , W. Nick Street , Stephen Baek , Qihang Lin , Jingyi Yang , Yankun Huang

Federated Learning (FL) enables collaborative model training across decentralized devices while preserving data privacy. However, traditional FL suffers from communication overhead, system heterogeneity, and straggler effects. Asynchronous…

Machine Learning · Computer Science 2025-08-05 Ali Forootani , Raffaele Iervolino

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

Machine Learning · Computer Science 2025-10-22 Ali Forootani , Raffaele Iervolino

Federated Learning (FL) offers a promising solution for training machine learning models across distributed data sources while preserving data privacy. However, FL faces critical challenges related to communication overhead and local…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Ziyue Xu , Zhihong Zhang , Holger R. Roth , Chester Chen , Yan Cheng , Andrew Feng

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

This paper investigates federated learning (FL) in a multi-hop communication setup, such as in constellations with inter-satellite links. In this setup, part of the FL clients are responsible for forwarding other client's results to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Sourav Mukherjee , Nasrin Razmi , Armin Dekorsy , Petar Popovski , Bho Matthiesen

Federated Learning (FL) is a decentralized machine learning protocol that allows a set of participating agents to collaboratively train a model without sharing their data. This makes FL particularly suitable for settings where data privacy…

Machine Learning · Computer Science 2020-10-30 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Federated Learning (FL) enables edge devices or clients to collaboratively train machine learning (ML) models without sharing their private data. Much of the existing work in FL focuses on efficiently learning a model for a single task. In…

Machine Learning · Computer Science 2024-06-05 Baris Askin , Pranay Sharma , Carlee Joe-Wong , Gauri Joshi

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Federated Learning (FL) has become a viable technique for realizing privacy-enhancing distributed deep learning on the network edge. Heterogeneous hardware, unreliable client devices, and energy constraints often characterize edge computing…

Machine Learning · Computer Science 2024-11-05 Herbert Woisetschläger , Alexander Erben , Ruben Mayer , Shiqiang Wang , Hans-Arno Jacobsen

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

Federated learning (FL) can achieve privacy-safe and reliable collaborative training without collecting users' private data. Its excellent privacy security potential promotes a wide range of FL applications in Internet-of-Things (IoT),…

Machine Learning · Computer Science 2023-09-26 Xiaofeng Liu , Qing Wang , Yunfeng Shao , Yinchuan Li

Federated Learning (FL) can be affected by data and device heterogeneities, caused by clients' different local data distributions and latencies in uploading model updates (i.e., staleness). Traditional schemes consider these heterogeneities…

Machine Learning · Computer Science 2024-12-25 Haoming Wang , Wei Gao

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

Federated Learning (FL) enables collaborative model training across distributed devices while safeguarding data and user privacy. However, FL remains susceptible to privacy threats that can compromise data via direct means. That said,…

Cryptography and Security · Computer Science 2025-12-12 Md Nahid Hasan Shuvo , Moinul Hossain , Anik Mallik , Jeffrey Twigg , Fikadu Dagefu