English
Related papers

Related papers: Local-Global Knowledge Distillation in Heterogeneo…

200 papers

Federated Learning (FL) offers a collaborative training framework, allowing multiple clients to contribute to a shared model without compromising data privacy. Due to the heterogeneous nature of local datasets, updated client models may…

Machine Learning · Computer Science 2023-11-14 Chia-Hsiang Kao , Yu-Chiang Frank Wang

Federated learning is a paradigm of joint learning in which clients collaborate by sharing model parameters instead of data. However, in the non-iid setting, the global model experiences client drift, which can seriously affect the final…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiaze Li , Haoran Xu , Wanyi Wu , Changwei Wang , Shuaiguang Li , Jianzhong Ju , Zhenbo Luo , Jian Luan , Youyang Qu , Longxiang Gao , Xudong Yang , Lumin Xing

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

In federated learning, clients share a global model that has been trained on decentralized local client data. Although federated learning shows significant promise as a key approach when data cannot be shared or centralized, current methods…

Machine Learning · Computer Science 2021-02-09 Edvin Listo Zec , Olof Mogren , John Martinsson , Leon René Sütfeld , Daniel Gillblad

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

Machine Learning · Computer Science 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

Federated Learning (FL) has emerged as a crucial distributed training paradigm, enabling discrete devices to collaboratively train a shared model under the coordination of a central server, while leveraging their locally stored private…

Machine Learning · Computer Science 2024-09-02 Wenhao Yuan , Xuehe Wang

Recent advances in collaborative knowledge distillation have demonstrated cutting-edge performance for resource-constrained distributed multimedia learning scenarios. However, achieving such competitiveness requires addressing a fundamental…

Machine Learning · Computer Science 2026-03-24 Jing Liu , Zhenchao Ma , Han Yu , Bobo Ju , Wenliang Yang , Chengfang Li , Bo Hu , Liang Song

One-shot Federated learning (FL) is a powerful technology facilitating collaborative training of machine learning models in a single round of communication. While its superiority lies in communication efficiency and privacy preservation…

Machine Learning · Computer Science 2024-12-09 Junyuan Zhang , Songhua Liu , Xinchao Wang

Federated learning (FL) is a distributed learning paradigm that maximizes the potential of data-driven models for edge devices without sharing their raw data. However, devices often have non-independent and identically distributed (non-IID)…

Machine Learning · Computer Science 2023-08-31 Zijian Li , Zehong Lin , Jiawei Shao , Yuyi Mao , Jun Zhang

Personalized federated learning, as a variant of federated learning, trains customized models for clients using their heterogeneously distributed data. However, it is still inconclusive about how to design personalized models with better…

Machine Learning · Computer Science 2023-02-23 Tiansheng Huang , Li Shen , Yan Sun , Weiwei Lin , Dacheng Tao

Federated learning (FL) provides a decentralized machine learning paradigm where a server collaborates with a group of clients to learn a global model without accessing the clients' data. User heterogeneity is a significant challenge for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jiangming Shi , Shanshan Zheng , Xiangbo Yin , Yang Lu , Yuan Xie , Yanyun Qu

Federated Learning (FL) suffers significant performance degradation in real-world deployments characterized by moderate to extreme statistical heterogeneity (non-IID client data). While global aggregation strategies promote broad…

Machine Learning · Computer Science 2026-03-11 Prakash Kumbhakar , Shrey Srivastava , Haroon R Lone

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private data. Most existing works simply propose typical FL systems for…

Machine Learning · Computer Science 2023-11-08 Huy Q. Le , Minh N. H. Nguyen , Chu Myaet Thwal , Yu Qiao , Chaoning Zhang , Choong Seon Hong

Federated Graph Learning (FGL) is tasked with training machine learning models, such as Graph Neural Networks (GNNs), for multiple clients, each with its own graph data. Existing methods usually assume that each client has both node…

Machine Learning · Computer Science 2024-11-14 Xingbo Fu , Song Wang , Yushun Dong , Binchi Zhang , Chen Chen , Jundong Li

Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across…

Machine Learning · Computer Science 2026-05-11 Ozgu Goksu , Nicolas Pugeault

Federated training of Graph Neural Networks (GNN) has become popular in recent years due to its ability to perform graph-related tasks under data isolation scenarios while preserving data privacy. However, graph heterogeneity issues in…

Machine Learning · Computer Science 2023-09-22 Qiying Pan , Ruofan Wu , Tengfei Liu , Tianyi Zhang , Yifei Zhu , Weiqiang Wang

Distributed time series data presents a challenge for federated learning, as clients often possess different feature sets and have misaligned time steps. Existing federated time series models are limited by the assumption of perfect…

Machine Learning · Computer Science 2025-08-15 Zhi Wen Soi , Chenrui Fan , Aditya Shankar , Abele Mălan , Lydia Y. Chen

Knowledge Distillation (KD) methods are capable of transferring the knowledge encoded in a large and complex teacher into a smaller and faster student. Early methods were usually limited to transferring the knowledge only between the last…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Nikolaos Passalis , Maria Tzelepi , Anastasios Tefas

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

With the development of wireless network, Multi-Access Edge Computing (MEC) and Artificial Intelligence (AI)-native Radio Access Network (RAN) have attracted significant attention. Particularly, the integration of AI-RAN and MEC is…

Machine Learning · Computer Science 2026-03-11 Luyao Zou , Hayoung Oh , Chu Myaet Thwal , Apurba Adhikary , Seohyeon Hong , Zhu Han