English
Related papers

Related papers: Local-Global Knowledge Distillation in Heterogeneo…

200 papers

Federated Reinforcement Learning (FedRL) improves sample efficiency while preserving privacy; however, most existing studies assume homogeneous agents, limiting its applicability in real-world scenarios. This paper investigates FedRL in…

Machine Learning · Computer Science 2025-02-04 Wenzheng Jiang , Ji Wang , Xiongtao Zhang , Weidong Bao , Cheston Tan , Flint Xiaofeng Fan

By letting local clients perform multiple local updates before communicating with a parameter server, modern federated learning algorithms such as FedAvg tackle the communication bottleneck problem in distributed learning and have found…

Machine Learning · Computer Science 2025-03-21 Jie Liu , Yongqiang Wang

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated learning is widely used in medical applications for training global models without needing local data access. However, varying computational capabilities and network architectures (system heterogeneity), across clients pose…

Machine Learning · Computer Science 2024-05-14 Luyuan Xie , Manqing Lin , Tianyu Luan , Cong Li , Yuejian Fang , Qingni Shen , Zhonghai Wu

Federated learning (FL) is an emerging technique used to collaboratively train a global machine learning model while keeping the data localized on the user devices. The main obstacle to FL's practical implementation is the Non-Independent…

Machine Learning · Computer Science 2022-08-01 Hiep Nguyen , Lam Phan , Harikrishna Warrier , Yogesh Gupta

Federated Learning (FL) enables the training of Deep Learning models without centrally collecting possibly sensitive raw data. The most used algorithms for FL are parameter-averaging based schemes (e.g., Federated Averaging) that, however,…

Machine Learning · Computer Science 2025-04-08 Alessio Mora , Irene Tenison , Paolo Bellavista , Irina Rish

Federated Learning (FL) models often experience client drift caused by heterogeneous data, where the distribution of data differs across clients. To address this issue, advanced research primarily focuses on manipulating the existing…

Machine Learning · Computer Science 2024-03-15 Zhenheng Tang , Yonggang Zhang , Shaohuai Shi , Xinmei Tian , Tongliang Liu , Bo Han , Xiaowen Chu

Heterogeneous Federated Learning (HtFL) enables task-specific knowledge sharing among clients with different model architectures while preserving privacy. Despite recent research progress, transferring knowledge in HtFL is still difficult…

Artificial Intelligence · Computer Science 2024-08-20 Jianqing Zhang , Yang Liu , Yang Hua , Jian Cao

Federated Learning (FL) provides decentralised model training, which effectively tackles problems such as distributed data and privacy preservation. However, the generalisation of global models frequently faces challenges from data…

Machine Learning · Computer Science 2025-09-05 Ozgu Goksu , Nicolas Pugeault

This paper introduces FedKDX, a federated learning framework that addresses limitations in healthcare AI through Negative Knowledge Distillation (NKD). Unlike existing approaches that focus solely on positive knowledge transfer, FedKDX…

Machine Learning · Computer Science 2026-01-09 Quang-Tu Pham , Hoang-Dieu Vu , Dinh-Dat Pham , Hieu H. Pham

Clustered Federated Learning (CFL) has emerged as a powerful approach for addressing data heterogeneity and ensuring privacy in large distributed IoT environments. By clustering clients and training cluster-specific models, CFL enables…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-12 Sabtain Ahmad , Meerzhan Kanatbekova , Ivona Brandic , Atakan Aral

Subgraph federated learning (subgraph-FL) is a new distributed paradigm that facilitates the collaborative training of graph neural networks (GNNs) by multi-client subgraphs. Unfortunately, a significant challenge of subgraph-FL arises from…

Machine Learning · Computer Science 2024-04-26 Yinlin Zhu , Xunkai Li , Zhengyu Wu , Di Wu , Miao Hu , Rong-Hua Li

In practical scenarios, federated learning frequently necessitates training personalized models for each client using heterogeneous data. This paper proposes a backbone self-distillation approach to facilitate personalized federated…

Machine Learning · Computer Science 2024-09-25 Pengju Wang , Bochao Liu , Dan Zeng , Chenggang Yan , Shiming Ge

Federated learning is an important privacy-preserving multi-party learning paradigm, involving collaborative learning with others and local updating on private data. Model heterogeneity and catastrophic forgetting are two crucial…

Machine Learning · Computer Science 2023-09-29 Wenke Huang , Mang Ye , Zekun Shi , Bo Du

Federated learning (FL) often degrades when clients hold heterogeneous non-Independent and Identically Distributed (non-IID) data and when some clients behave adversarially, leading to client drift, slow convergence, and high communication…

Machine Learning · Computer Science 2026-03-06 Hamza Reguieg , Mohamed El Kamili , Essaid Sabir

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

Machine Learning · Computer Science 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

Federated Learning (FL) enables a group of clients to collaboratively train a model without sharing individual data, but its performance drops when client data are heterogeneous. Clustered FL tackles this by grouping similar clients.…

Machine Learning · Computer Science 2026-03-02 Anik Pramanik , Murat Kantarcioglu , Vincent Oria , Shantanu Sharma

Federated learning enables collaborative model training across distributed entities while maintaining individual data privacy. A key challenge in federated learning is balancing the personalization of models for local clients with…

Machine Learning · Computer Science 2025-04-07 Wai Fong Tam , Qilei Li , Ahmed M. Abdelmonie
‹ Prev 1 3 4 5 6 7 10 Next ›