English
Related papers

Related papers: Communication Efficient Federated Learning with Li…

200 papers

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Federated learning is a new distributed machine learning framework, where a bunch of heterogeneous clients collaboratively train a model without sharing training data. In this work, we consider a practical and ubiquitous issue when…

Machine Learning · Statistics 2023-09-06 Yikai Yan , Chaoyue Niu , Yucheng Ding , Zhenzhe Zheng , Fan Wu , Guihai Chen , Shaojie Tang , Zhihua Wu

Federated learning (FL) involves training a model over massive distributed devices, while keeping the training data localized. This form of collaborative learning exposes new tradeoffs among model convergence speed, model accuracy, balance…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-31 Zheng Chai , Yujing Chen , Ali Anwar , Liang Zhao , Yue Cheng , Huzefa Rangwala

Federated learning is a distributed optimization paradigm that allows training machine learning models across decentralized devices while keeping the data localized. The standard method, FedAvg, suffers from client drift which can hamper…

Machine Learning · Computer Science 2024-04-15 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

In Federated Learning (FL), a number of clients or devices collaborate to train a model without sharing their data. Models are optimized locally at each client and further communicated to a central hub for aggregation. While FL is an…

Machine Learning · Computer Science 2023-07-25 Farshid Varno , Marzie Saghayi , Laya Rafiee Sevyeri , Sharut Gupta , Stan Matwin , Mohammad Havaei

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Methods for training models on graphs distributed across multiple clients have recently grown in popularity, due to the size of these graphs as well as regulations on keeping data where it is generated. However, the cross-client edges…

Machine Learning · Computer Science 2023-12-19 Yuhang Yao , Weizhao Jin , Srivatsan Ravi , Carlee Joe-Wong

Federated learning (FL) is a promising framework for privacy-preserving collaborative learning, where model training tasks are distributed to clients and only the model updates need to be collected at a server. However, when being deployed…

Machine Learning · Computer Science 2024-04-09 Yuchang Sun , Yuyi Mao , Jun Zhang

Federated learning has emerged as a new paradigm of collaborative machine learning; however, it has also faced several challenges such as non-independent and identically distributed(IID) data and high communication cost. To this end, we…

Machine Learning · Computer Science 2020-12-10 Jin-woo Lee , Jaehoon Oh , Yooju Shin , Jae-Gil Lee , Se-Young Yoon

Federated learning (FL) commonly involves clients with diverse communication and computational capabilities. Such heterogeneity can significantly distort the optimization dynamics and lead to objective inconsistency, where the global model…

Machine Learning · Computer Science 2026-02-24 Shudi Weng , Chao Ren , Ming Xiao , Mikael Skoglund

Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks, but its practical deployment is hindered by the high communication overhead caused by frequent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-22 Shuai Wang , Yanqing Xu , Chaoqun You , Mingjie Shao , Tony Q. S. Quek

Federated learning on heterogeneous (non-IID) client data experiences slow convergence due to client drift. To address this challenge, we propose Kuramoto-FedAvg, a federated optimization algorithm that reframes the weight aggregation step…

Machine Learning · Computer Science 2025-05-27 Aggrey Muhebwa , Khotso Selialia , Fatima Anwar , Khalid K. Osman

Cross-silo federated learning offers a promising solution to collaboratively train robust and generalized AI models without compromising the privacy of local datasets, e.g., healthcare, financial, as well as scientific projects that lack a…

Federated learning enables multiple clients to collaboratively learn a global model by periodically aggregating the clients' models without transferring the local data. However, due to the heterogeneity of the system and data, many…

Machine Learning · Computer Science 2021-09-14 Dezhong Yao , Wanning Pan , Yutong Dai , Yao Wan , Xiaofeng Ding , Hai Jin , Zheng Xu , Lichao Sun

Federated learning (FL) is a machine learning paradigm that allows multiple clients to collaboratively train a shared model without exposing their private data. Data heterogeneity is a fundamental challenge in FL, which can result in poor…

Machine Learning · Computer Science 2025-08-21 Tao Shen , Zexi Li , Didi Zhu , Ziyu Zhao , Chao Wu , Fei Wu

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Machine Learning · Computer Science 2025-09-18 Gergely D. Németh , Eros Fanì , Yeat Jeng Ng , Barbara Caputo , Miguel Ángel Lozano , Nuria Oliver , Novi Quadrianto

We consider a standard federated learning (FL) architecture where a group of clients periodically coordinate with a central server to train a statistical model. We develop a general algorithmic framework called FedLin to tackle some of the…

Machine Learning · Computer Science 2021-09-01 Aritra Mitra , Rayana Jaafar , George J. Pappas , Hamed Hassani

Efficient collaboration between collaborative machine learning and wireless communication technology, forming a Federated Edge Learning (FEEL), has spawned a series of next-generation intelligent applications. However, due to the openness…

Machine Learning · Computer Science 2021-11-05 Yi Liu , Yuanshao Zhu , James J. Q. Yu