English
Related papers

Related papers: FedMD: Heterogenous Federated Learning via Model D…

200 papers

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated Learning (FL) is gaining popularity as a distributed learning framework that only shares model parameters or gradient updates and keeps private data locally. However, FL is at risk of privacy leakage caused by privacy inference…

Machine Learning · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu

In practical scenarios, federated learning frequently necessitates training personalized models for each client using heterogeneous data. This paper proposes a backbone self-distillation approach to facilitate personalized federated…

Machine Learning · Computer Science 2024-09-25 Pengju Wang , Bochao Liu , Dan Zeng , Chenggang Yan , Shiming Ge

Federated learning (FL) has emerged as a transformative training paradigm, particularly invaluable in privacy-sensitive domains like healthcare. However, client heterogeneity in data, computing power, and tasks poses a significant…

Machine Learning · Computer Science 2024-10-01 Huidong Tang , Chen Li , Huachong Yu , Sayaka Kamei , Yasuhiko Morimoto

Federated learning benefits from cross-training strategies, which enables models to train on data from distinct sources to improve generalization capability. However, due to inherent differences in data distributions, the optimization goals…

Artificial Intelligence · Computer Science 2025-09-17 Zhuang Qi , Lei Meng , Ruohan Zhang , Yu Wang , Xin Qi , Xiangxu Meng , Han Yu , Qiang Yang

Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to construct large public datasets for machine learning.…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Jiebo Luo , Andrew White

In medical imaging, developing generalized segmentation models that can handle multiple organs and lesions is crucial. However, the scarcity of fully annotated datasets and strict privacy regulations present significant barriers to data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Pochuan Wang , Chen Shen , Masahiro Oda , Chiou-Shann Fuh , Kensaku Mori , Weichung Wang , Holger R. Roth

Personalized medication aims to tailor healthcare to individual patient characteristics. However, the heterogeneity of patient data across healthcare systems presents significant challenges to achieving accurate and effective personalized…

Artificial Intelligence · Computer Science 2024-12-10 Jiechao Gao , Yuangang Li

Machine learning in medical research, by nature, needs careful attention on obeying the regulations of data privacy, making it difficult to train a machine learning model over gathered data from different medical centers. Failure of…

Machine Learning · Computer Science 2021-10-19 Jun Luo , Shandong Wu

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the…

Machine Learning · Computer Science 2022-01-25 Chen Wu , Sencun Zhu , Prasenjit Mitra

Federated learning (FL) offers a privacy-preserving framework for distributed machine learning, enabling collaborative model training across diverse clients without centralizing sensitive data. However, statistical heterogeneity,…

Machine Learning · Statistics 2025-04-08 Hengrui Hu , Anai N. Kothari , Anjishnu Banerjee

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Federated learning (FL) offers a promising framework for collaborative digital pathology by enabling model training across institutions. However, real-world deployments face heterogeneity arising from diverse multiple instance learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Luru Jing , Cong Cong , Yanyuan Chen , Yongzhi Cao

This paper presents FedX, an unsupervised federated learning framework. Our model learns unbiased representation from decentralized and heterogeneous local data. It employs a two-sided knowledge distillation with contrastive learning as a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sungwon Han , Sungwon Park , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xing Xie , Meeyoung Cha

In federated learning, a strong global model is collaboratively learned by aggregating clients' locally trained models. Although this precludes the need to access clients' data directly, the global model's convergence often suffers from…

Machine Learning · Computer Science 2022-11-30 Gihun Lee , Minchan Jeong , Yongjin Shin , Sangmin Bae , Se-Young Yun

Collaborative fairness is a crucial challenge in federated learning. However, existing approaches often overlook a practical yet complex form of heterogeneity: imbalanced covariate shift. We provide a theoretical analysis of this setting,…

Machine Learning · Computer Science 2025-07-14 Tianrun Yu , Jiaqi Wang , Haoyu Wang , Mingquan Lin , Han Liu , Nelson S. Yee , Fenglong Ma

Knowledge distillation is an effective method to transfer the knowledge from the cumbersome teacher model to the lightweight student model. Online knowledge distillation uses the ensembled prediction results of multiple student models as…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Zheng Li , Ying Huang , Defang Chen , Tianren Luo , Ning Cai , Zhigeng Pan

Federated Learning (FL) stands as a prominent distributed learning paradigm among multiple clients to achieve a unified global model without privacy leakage. In contrast to FL, Personalized federated learning aims at serving for each client…

Machine Learning · Computer Science 2026-03-24 Tao Feng , Jie Zhang , Xiangjian Li , Rong Huang , Huashan Liu , Zhijie Wang

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang