English
Related papers

Related papers: Federated style aware transformer aggregation of r…

200 papers

Model-Heterogeneous Federated Learning (Hetero-FL) has attracted growing attention for its ability to aggregate knowledge from heterogeneous models while keeping private data locally. To better aggregate knowledge from clients, ensemble…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Xiuying Wang , Wenchao Xu , Haozhao Wang , Yining Qi , Jiahua Dong , Ruixuan Li

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Large models, renowned for superior performance, outperform smaller ones even without billion-parameter scales. While mobile network servers have ample computational resources to support larger models than client devices, privacy…

Machine Learning · Computer Science 2025-08-20 Wenxuan Ye , Xueli An , Onur Ayan , Junfan Wang , Xueqiang Yan , Georg Carle

Federated Learning (FL) enables decentralized model training across multiple clients without exposing private data, making it ideal for privacy-sensitive applications. However, in real-world FL scenarios, clients often hold data from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Huy Q. Le , Loc X. Nguyen , Yu Qiao , Seong Tae Kim , Eui-Nam Huh , Choong Seon Hong

Personalized Federated Learning (PFL) aims to learn personalized models for each client based on the knowledge across all clients in a privacy-preserving manner. Existing PFL methods generally assume that the underlying global data across…

Machine Learning · Computer Science 2023-03-28 Yang Lu , Pinxin Qian , Gang Huang , Hanzi Wang

Distributed Learning (DL) enables the training of machine learning models across multiple devices, yet it faces challenges like non-IID data distributions and device capability disparities, which can impede training efficiency.…

Machine Learning · Computer Science 2025-02-20 Mengchen Fan , Keren Li , Tianyun Zhang , Qing Tian , Baocheng Geng

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

To eliminate the requirement of fully-labeled data for supervised model training in traditional Federated Learning (FL), extensive attention has been paid to the application of Self-supervised Learning (SSL) approaches on FL to tackle the…

Machine Learning · Computer Science 2022-11-15 Yi Liu , Song Guo , Jie Zhang , Qihua Zhou , Yingchun Wang , Xiaohan Zhao

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgetting, where the model rapidly forgets previous knowledge while…

Machine Learning · Computer Science 2024-11-07 Pengju Wang , Bochao Liu , Weijia Guo , Yong Li , Shiming Ge

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

Machine Learning · Computer Science 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Personalized federated learning (PFL) tailors models to clients' unique data distributions while preserving privacy. However, existing aggregation-weight-based PFL methods often struggle with heterogeneous data, facing challenges in…

Machine Learning · Computer Science 2025-02-18 Yuxia Sun , Aoxiang Sun , Siyi Pan , Zhixiao Fu , Jingcai Guo

Personalized Federated Learning (PerFL) is a new machine learning paradigm that delivers personalized models for diverse clients under federated learning settings. Most PerFL methods require extra learning processes on a client to adapt a…

Machine Learning · Computer Science 2024-03-29 Peng Yan , Guodong Long

Personalized federated learning (PFL) aims to harness the collective wisdom of clients' data while building personalized models tailored to individual clients' data distributions. Existing works offer personalization primarily to clients…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Hong-You Chen , Jike Zhong , Mingda Zhang , Xuhui Jia , Hang Qi , Boqing Gong , Wei-Lun Chao , Li Zhang

Traditional federated learning (FL) algorithms operate under the assumption that the data distributions at training (source domains) and testing (target domain) are the same. The fact that domain shifts often occur in practice necessitates…

Machine Learning · Computer Science 2023-11-02 Jungwuk Park , Dong-Jun Han , Jinho Kim , Shiqiang Wang , Christopher G. Brinton , Jaekyun Moon

Federated learning (FL) has become a prevalent distributed machine learning paradigm with improved privacy. After learning, the resulting federated model should be further personalized to each different client. While several methods have…

Machine Learning · Computer Science 2021-03-09 Bingyan Liu , Yao Guo , Xiangqun Chen

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Machine Learning · Computer Science 2025-09-18 Gergely D. Németh , Eros Fanì , Yeat Jeng Ng , Barbara Caputo , Miguel Ángel Lozano , Nuria Oliver , Novi Quadrianto

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari