English
Related papers

Related papers: Closing the Gap between Client and Global Model Pe…

200 papers

Model-Heterogeneous Federated Learning (Hetero-FL) has attracted growing attention for its ability to aggregate knowledge from heterogeneous models while keeping private data locally. To better aggregate knowledge from clients, ensemble…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Xiuying Wang , Wenchao Xu , Haozhao Wang , Yining Qi , Jiahua Dong , Ruixuan Li

One of the key challenges of collaborative machine learning, without data sharing, is multimodal data heterogeneity in real-world settings. While Federated Learning (FL) enables model training across multiple clients, existing frameworks,…

Machine Learning · Computer Science 2025-10-16 Alejandro Guerra-Manzanares , Omar El-Herraoui , Michail Maniatakos , Farah E. Shamout

Federated Learning (FL) is a prominent framework that enables training a centralized model while securing user privacy by fusing local, decentralized models. In this setting, one major obstacle is data heterogeneity, i.e., each client…

Machine Learning · Computer Science 2022-06-22 Artur Back de Luca , Guojun Zhang , Xi Chen , Yaoliang Yu

Traditional Federated Learning (FL) faces significant challenges in terms of efficiency and accuracy, particularly in heterogeneous environments where clients employ diverse model architectures and have varying computational resources. Such…

Machine Learning · Computer Science 2025-05-13 Jiacheng Wang , Hongtao Lv , Lei Liu

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

Federated Learning (FL) enables a group of clients to collaboratively train a model without sharing individual data, but its performance drops when client data are heterogeneous. Clustered FL tackles this by grouping similar clients.…

Machine Learning · Computer Science 2026-03-02 Anik Pramanik , Murat Kantarcioglu , Vincent Oria , Shantanu Sharma

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Federated learning (FL) is a distributed training paradigm that enables collaborative learning across clients without sharing local data, thereby preserving privacy. However, the increasing scale and complexity of modern deep models often…

Machine Learning · Computer Science 2025-05-20 Honggu Kang , Seohyeon Cha , Joonhyuk Kang

Federated Learning (FL) is a privacy-constrained decentralized machine learning paradigm in which clients enable collaborative training without compromising private data. However, how to learn a robust global model in the data-heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Kangyang Luo , Shuai Wang , Yexuan Fu , Xiang Li , Yunshi Lan , Ming Gao

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

Machine Learning · Computer Science 2023-12-29 Ho Man Kwan , Shenghui Song

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Federated Learning (FL) is a distributed learning paradigm that empowers edge devices to collaboratively learn a global model leveraging local data. Simulating FL on GPU is essential to expedite FL algorithm prototyping and evaluations.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-26 Min Zhang , Fuxun Yu , Yongbo Yu , Minjia Zhang , Ang Li , Xiang Chen

Federated learning (FL) is a privacy-preserving paradigm for collaboratively training a global model from decentralized clients. However, the performance of FL is hindered by non-independent and identically distributed (non-IID) data and…

Machine Learning · Computer Science 2024-03-08 Xinyu Zhang , Weiyu Sun , Ying Chen

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Personalized federated learning (FL) aims to train model(s) that can perform well for individual clients that are highly data and system heterogeneous. Most work in personalized FL, however, assumes using the same model architecture at all…

Machine Learning · Computer Science 2021-09-17 Yae Jee Cho , Jianyu Wang , Tarun Chiruvolu , Gauri Joshi

Federated Learning (FL) recently emerges as a paradigm to train a global machine learning model across distributed clients without sharing raw data. Knowledge Graph (KG) embedding represents KGs in a continuous vector space, serving as the…

Machine Learning · Computer Science 2023-02-28 Xiangrong Zhu , Guangyao Li , Wei Hu

Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using…

Machine Learning · Computer Science 2024-06-04 Pengchao Han , Xingyan Shi , Jianwei Huang

Federated graph learning (FGL) has emerged as a promising paradigm for collaborative graph representation learning, enabling multiple parties to jointly train models while preserving data privacy. However, most existing approaches assume…

Machine Learning · Computer Science 2026-01-01 Zhengyu Wu , Guang Zeng , Huilin Lai , Daohan Su , Jishuo Jia , Yinlin Zhu , Xunkai Li , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

Machine Learning · Computer Science 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao