English
Related papers

Related papers: Local-Global Knowledge Distillation in Heterogeneo…

200 papers

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Seongyoon Kim , Minchan Jeong , Sungnyun Kim , Sungwoo Cho , Sumyeong Ahn , Se-Young Yun

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Personalized Federated Learning (PFL) focuses on tailoring models to individual IIoT clients in federated learning by addressing data heterogeneity and diverse user needs. Although existing studies have proposed effective PFL solutions from…

Artificial Intelligence · Computer Science 2024-12-03 Yingchao Wang , Wenqi Niu

In real-world applications, Federated Learning (FL) meets two challenges: (1) scalability, especially when applied to massive IoT networks; and (2) how to be robust against an environment with heterogeneous data. Realizing the first…

Machine Learning · Computer Science 2022-10-03 Minh-Duong Nguyen , Quoc-Viet Pham , Dinh Thai Hoang , Long Tran-Thanh , Diep N. Nguyen , Won-Joo Hwang

Federated learning enables edge devices to train a global model collaboratively without exposing their data. Despite achieving outstanding advantages in computing efficiency and privacy protection, federated learning faces a significant…

Federated learning has become a promising solution for collaboration among medical institutions. However, data owned by each institution would be highly heterogeneous and the distribution is always non-independent and identical distribution…

Machine Learning · Computer Science 2024-12-25 Guochen Yan , Luyuan Xie , Xinyi Gao , Wentao Zhang , Qingni Shen , Yuejian Fang , Zhonghai Wu

Knowledge distillation (KD) is a widely adopted technique for transferring knowledge from a high-capacity teacher model to a smaller student model by aligning their output distributions. However, existing methods often underperform in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Seonghak Kim

Federated learning achieves joint training of deep models by connecting decentralized data sources, which can significantly mitigate the risk of privacy leakage. However, in a more general case, the distributions of labels among clients are…

Machine Learning · Computer Science 2022-12-20 Tao Sheng , Chengchao Shen , Yuan Liu , Yeyu Ou , Zhe Qu , Jianxin Wang

While existing federated learning approaches primarily focus on aggregating local models to construct a global model, in realistic settings, some clients may be reluctant to share their private models due to the inclusion of…

Machine Learning · Computer Science 2025-07-01 Lingzhi Gao , Zhenyuan Zhang , Chao Wu

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

Machine Learning · Computer Science 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Federated Learning (FL) suffers from severe performance degradation due to the data heterogeneity among clients. Existing works reveal that the fundamental reason is that data heterogeneity can cause client drift where the local model…

Machine Learning · Computer Science 2025-01-22 Haoran Xu , Jiaze Li , Wanyi Wu , Hao Ren

Federated learning (FL) is an emerging machine learning paradigm that allows multiple parties to train a shared model collaboratively in a privacy-preserving manner. Existing horizontal FL methods generally assume that the FL server and…

Machine Learning · Computer Science 2023-08-02 Liping Yi , Gang Wang , Xiaoguang Liu , Zhuan Shi , Han Yu

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Federated learning protects data privacy and security by exchanging models instead of data. However, unbalanced data distributions among participating clients compromise the accuracy and convergence speed of federated learning algorithms.…

Machine Learning · Computer Science 2022-04-11 Qilong Wu , Lin Liu , Shibei Xue

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

Machine Learning · Computer Science 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing…

Machine Learning · Computer Science 2026-01-29 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Mingjin Zhang

Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on…

Machine Learning · Computer Science 2021-09-02 Yujing Chen , Zheng Chai , Yue Cheng , Huzefa Rangwala

Federated Learning (FL) has emerged as a promising approach to enable collaborative learning among multiple clients while preserving data privacy. However, cross-domain FL tasks, where clients possess data from different domains or…

Machine Learning · Computer Science 2024-04-02 Yuwen Yang , Chang Liu , Xun Cai , Suizhi Huang , Hongtao Lu , Yue Ding