English
Related papers

Related papers: Tackling Data Heterogeneity in Federated Learning …

200 papers

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Heterogeneity in federated learning (FL) is a critical and challenging aspect that significantly impacts model performance and convergence. In this paper, we propose a novel framework by formulating heterogeneous FL as a hierarchical…

Optimization and Control · Mathematics 2025-09-11 Yuyang Qiu , Kibaek Kim , Farzad Yousefian

There is growing research interest in measuring the statistical heterogeneity of clients' local datasets. Such measurements are used to estimate the suitability for collaborative training of personalized federated learning (PFL) models.…

Machine Learning · Computer Science 2024-10-29 Zhilong Li , Xiaohu Wu , Xiaoli Tang , Tiantian He , Yew-Soon Ong , Mengmeng Chen , Qiqi Liu , Qicheng Lao , Han Yu

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

Machine Learning · Computer Science 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Federated learning (FL) is an emerging machine learning paradigm that allows multiple parties to train a shared model collaboratively in a privacy-preserving manner. Existing horizontal FL methods generally assume that the FL server and…

Machine Learning · Computer Science 2023-08-02 Liping Yi , Gang Wang , Xiaoguang Liu , Zhuan Shi , Han Yu

Federated Learning is a distributed machine-learning environment that allows clients to learn collaboratively without sharing private data. This is accomplished by exchanging parameters. However, the differences in data distributions and…

Machine Learning · Computer Science 2023-03-17 Kuang Hangdong , Mi Bo

Federated Learning (FL) is a distributed machine learning paradigm that achieves a globally robust model through decentralized computation and periodic model synthesis, primarily focusing on the global model's accuracy over aggregated…

Machine Learning · Computer Science 2024-11-27 Han Liang , Ziwei Zhan , Weijie Liu , Xiaoxi Zhang , Chee Wei Tan , Xu Chen

Federated learning (FL) is a distributed machine learning technique in which multiple clients cooperate to train a shared model without exchanging their raw data. However, heterogeneity of data distribution among clients usually leads to…

Machine Learning · Computer Science 2023-03-23 Yu Qiao , Seong-Bae Park , Sun Moo Kang , Choong Seon Hong

Although common in real-world applications, heterogeneous client label sets are rarely investigated in federated learning (FL). Furthermore, in the cases they are, clients are assumed to be willing to share their entire label sets with…

Machine Learning · Computer Science 2025-08-27 Adam Breitholtz , Edvin Listo Zec , Fredrik D. Johansson

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

Machine Learning · Computer Science 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen

As privacy concerns continue to grow, federated learning (FL) has gained significant attention as a promising privacy-preserving technology, leading to considerable advancements in recent years. Unlike traditional machine learning, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Boyu Fan , Siyang Jiang , Xiang Su , Sasu Tarkoma , Pan Hui

Federated learning (FL) has been proposed to protect data privacy and virtually assemble the isolated data silos by cooperatively training models among organizations without breaching privacy and security. However, FL faces heterogeneity…

Machine Learning · Computer Science 2022-10-11 Dashan Gao , Xin Yao , Qiang Yang

Federated learning, which allows multiple client devices in a network to jointly train a machine learning model without direct exposure of clients' data, is an emerging distributed learning technique due to its nature of privacy…

Machine Learning · Computer Science 2023-03-22 Jing Zhang , Chuanwen Li , Jianzgong Qi , Jiayuan He

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm. Traditional FL requires all data owners (a.k.a. FL clients) to train the same local model. This design is not well-suited for scenarios involving…

Machine Learning · Computer Science 2024-04-22 Liping Yi , Han Yu , Zhuan Shi , Gang Wang , Xiaoguang Liu , Lizhen Cui , Xiaoxiao Li

Federated learning (FL) is a promising approach for training decentralized data located on local client devices while improving efficiency and privacy. However, the distribution and quantity of the training data on the clients' side may…

Machine Learning · Computer Science 2020-12-16 Lixu Wang , Shichao Xu , Xiao Wang , Qi Zhu

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated Learning (FL) enables collaborative training of distributed clients while protecting privacy. To enhance generalization capability in FL, prototype-based FL is in the spotlight, since shared global prototypes offer semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huan Wang , Jun Shen , Haoran Li , Zhenyu Yang , Jun Yan , Ousman Manjang , Yanlong Zhai , Di Wu , Guansong Pang

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners. Wide adoption of FL faces the fundamental challenges of data heterogeneity and the large scale of data…

Machine Learning · Computer Science 2023-08-23 Yulan Gao , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Han Yu

Federated Learning (FL) enables multiple nodes to collaboratively train a model without sharing raw data. However, FL systems are usually deployed in heterogeneous scenarios, where nodes differ in both data distributions and participation…

Machine Learning · Computer Science 2026-02-13 Hongliang Zhang , Jiguo Yu , Guijuan Wang , Wenshuo Ma , Tianqing He , Baobao Chai , Chunqiang Hu