English
Related papers

Related papers: FedRolex: Model-Heterogeneous Federated Learning w…

200 papers

Federated Learning (FL) has emerged as a fundamental learning paradigm to harness massive data scattered at geo-distributed edge devices in a privacy-preserving way. Given the heterogeneous deployment of edge devices, however, their data…

Networking and Internet Architecture · Computer Science 2024-05-30 Mulei Ma , Chenyu Gong , Liekang Zeng , Yang Yang , Liantao Wu

Federated learning (FL) has been widely adopted for collaborative training on decentralized data. However, it faces the challenges of data, system, and model heterogeneity. This has inspired the emergence of model-heterogeneous personalized…

Machine Learning · Computer Science 2024-02-13 Liping Yi , Han Yu , Chao Ren , Heng Zhang , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

Federated Learning (FL) provides a privacy-preserving framework for training machine learning models on mobile edge devices. Traditional FL algorithms, e.g., FedAvg, impose a heavy communication workload on these devices. To mitigate this…

Machine Learning · Computer Science 2024-10-01 Zhidong Gao , Yu Zhang , Yanmin Gong , Yuanxiong Guo

Mobile Edge Computing (MEC), which incorporates the Cloud, edge nodes and end devices, has shown great potential in bringing data processing closer to the data sources. Meanwhile, Federated learning (FL) has emerged as a promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Wentai Wu , Ligang He , Weiwei Lin , Rui Mao

Federated Learning (FL) has emerged as a promising paradigm for privacy-preserving collaborative learning, yet data heterogeneity remains a critical challenge. While existing methods achieve progress in addressing data heterogeneity for…

Machine Learning · Computer Science 2025-08-19 Yuhao Zhou , Jindi Lv , Yuxin Tian , Dan Si , Qing Ye , Jiancheng Lv

Federated learning (FL) is a privacy-preserving distributed learning paradigm that enables clients to jointly train a global model. In real-world FL implementations, client data could have label noise, and different clients could have…

Machine Learning · Computer Science 2022-04-12 Jingyi Xu , Zihan Chen , Tony Q. S. Quek , Kai Fong Ernest Chong

Despite recent advancements in federated learning (FL) for medical image diagnosis, addressing data heterogeneity among clients remains a significant challenge for practical implementation. A primary hurdle in FL arises from the non-IID…

Machine Learning · Computer Science 2024-07-09 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

In Federated Learning (FL), a number of clients or devices collaborate to train a model without sharing their data. Models are optimized locally at each client and further communicated to a central hub for aggregation. While FL is an…

Machine Learning · Computer Science 2023-07-25 Farshid Varno , Marzie Saghayi , Laya Rafiee Sevyeri , Sharut Gupta , Stan Matwin , Mohammad Havaei

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

Foundation models (FMs) exhibit remarkable generalization but require adaptation to downstream tasks, particularly in privacy-sensitive applications. Due to data privacy regulations, cloud-based FMs cannot directly access private edge data,…

Machine Learning · Computer Science 2025-08-25 Guangyu Sun , Jingtao Li , Weiming Zhuang , Chen Chen , Chen Chen , Lingjuan Lyu

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

Federated Learning (FL) seeks to distribute model training across local clients without collecting data in a centralized data-center, hence removing data-privacy concerns. A major challenge for FL is data heterogeneity (where each client's…

Machine Learning · Computer Science 2022-09-22 Junjiao Tian , James Seale Smith , Zsolt Kira

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

Federated Learning (FL) is a machine learning technique that often suffers from training instability due to the diverse nature of client data. Although utility-based client selection methods like Oort are used to converge by prioritizing…

Machine Learning · Computer Science 2025-08-12 Md. Akmol Masud , Md Abrar Jahin , Mahmud Hasan

Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning model without exchanging their own local data. In this way, the server can exploit the computational power of all clients and train the model on a…

Machine Learning · Computer Science 2023-07-04 Song Wang , Xingbo Fu , Kaize Ding , Chen Chen , Huiyuan Chen , Jundong Li

Federated Learning (FL) is a decentralized learning method used to train machine learning algorithms. In FL, a global model iteratively collects the parameters of local models without accessing their local data. However, a significant…

Machine Learning · Computer Science 2023-08-29 Mingjie Wang , Jianxiong Guo , Weijia Jia

Although Federated Learning (FL) enables global model training across clients without compromising their raw data, due to the unevenly distributed data among clients, existing Federated Averaging (FedAvg)-based methods suffer from the…

Machine Learning · Computer Science 2024-07-08 Ming Hu , Zhihao Yue , Xiaofei Xie , Cheng Chen , Yihao Huang , Xian Wei , Xiang Lian , Yang Liu , Mingsong Chen

Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based…

Machine Learning · Computer Science 2022-07-21 Yuanhao Xiong , Ruochen Wang , Minhao Cheng , Felix Yu , Cho-Jui Hsieh

With the increasing availability of Foundation Models, federated tuning has garnered attention in the field of federated learning, utilizing data and computation resources from multiple clients to collaboratively fine-tune foundation…

Machine Learning · Computer Science 2024-03-13 Shangchao Su , Bin Li , Xiangyang Xue