English
Related papers

Related papers: Spectral Co-Distillation for Personalized Federate…

200 papers

In practical scenarios, federated learning frequently necessitates training personalized models for each client using heterogeneous data. This paper proposes a backbone self-distillation approach to facilitate personalized federated…

Machine Learning · Computer Science 2024-09-25 Pengju Wang , Bochao Liu , Dan Zeng , Chenggang Yan , Shiming Ge

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by…

Machine Learning · Computer Science 2021-03-30 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

Traditional Federated Learning (FL) methods typically train a single global model collaboratively without exchanging raw data. In contrast, Personalized Federated Learning (PFL) techniques aim to create multiple models that are better…

Machine Learning · Computer Science 2024-04-23 Emilio Cantu-Cervini

Federated learning (FL) enables multiple clients to collaboratively train a global model while keeping local data decentralized. Data heterogeneity (non-IID) across clients has imposed significant challenges to FL, which makes local models…

Machine Learning · Computer Science 2025-04-22 Yuting He , Yiqiang Chen , XiaoDong Yang , Hanchao Yu , Yi-Hua Huang , Yang Gu

This paper addresses the challenge of mitigating data heterogeneity among clients within a Federated Learning (FL) framework. The model-drift issue, arising from the noniid nature of client data, often results in suboptimal personalization…

Machine Learning · Computer Science 2024-02-19 Kawa Atapour , S. Jamal Seyedmohammadi , Jamshid Abouei , Arash Mohammadi , Konstantinos N. Plataniotis

Federated learning (FL) offers a privacy-preserving framework for distributed machine learning, enabling collaborative model training across diverse clients without centralizing sensitive data. However, statistical heterogeneity,…

Machine Learning · Statistics 2025-04-08 Hengrui Hu , Anai N. Kothari , Anjishnu Banerjee

Federated Learning (FL) enables the training of Deep Learning models without centrally collecting possibly sensitive raw data. The most used algorithms for FL are parameter-averaging based schemes (e.g., Federated Averaging) that, however,…

Machine Learning · Computer Science 2025-04-08 Alessio Mora , Irene Tenison , Paolo Bellavista , Irina Rish

Federated learning enables collaborative model training without sharing raw data, but its performance can degrade substantially under heterogeneous client data distributions. A single global model often cannot satisfy diverse client…

Machine Learning · Computer Science 2026-05-27 Yunseok Kang , Jaeyoung Song

Federated Learning (FL) enables multiple machines to collaboratively train a machine learning model without sharing of private training data. Yet, especially for heterogeneous models, a key bottleneck remains the transfer of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Sunny Soni , Aaqib Saeed , Yuki M. Asano

Personalized federated learning (FL) facilitates collaborations between multiple clients to learn personalized models without sharing private data. The mechanism mitigates the statistical heterogeneity commonly encountered in the system,…

Machine Learning · Computer Science 2022-09-23 Zichen Ma , Yu Lu , Wenye Li , Shuguang Cui

In medical imaging, developing generalized segmentation models that can handle multiple organs and lesions is crucial. However, the scarcity of fully annotated datasets and strict privacy regulations present significant barriers to data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Pochuan Wang , Chen Shen , Masahiro Oda , Chiou-Shann Fuh , Kensaku Mori , Weichung Wang , Holger R. Roth

Heterogeneity of data distributed across clients limits the performance of global models trained through federated learning, especially in the settings with highly imbalanced class distributions of local datasets. In recent years,…

Machine Learning · Computer Science 2023-04-11 Huancheng Chen , Johnny , Wang , Haris Vikalo

Federated learning is widely used in medical applications for training global models without needing local data access. However, varying computational capabilities and network architectures (system heterogeneity), across clients pose…

Machine Learning · Computer Science 2024-05-14 Luyuan Xie , Manqing Lin , Tianyu Luan , Cong Li , Yuejian Fang , Qingni Shen , Zhonghai Wu

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

Machine Learning · Computer Science 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively train a central model while the training data remains decentralized. Existing FL methods typically share model parameters or employ co-distillation to…

Cryptography and Security · Computer Science 2022-09-13 Xuan Gong , Abhishek Sharma , Srikrishna Karanam , Ziyan Wu , Terrence Chen , David Doermann , Arun Innanje

Federated Learning (FL) is a novel approach that allows for collaborative machine learning while preserving data privacy by leveraging models trained on decentralized devices. However, FL faces challenges due to non-uniformly distributed…

Machine Learning · Computer Science 2024-04-16 Changlin Song , Divya Saxena , Jiannong Cao , Yuqing Zhao

Model-Heterogeneous Federated Learning (Hetero-FL) has attracted growing attention for its ability to aggregate knowledge from heterogeneous models while keeping private data locally. To better aggregate knowledge from clients, ensemble…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Xiuying Wang , Wenchao Xu , Haozhao Wang , Yining Qi , Jiahua Dong , Ruixuan Li

Federated Learning (FL) is designed as a decentralized, privacy-preserving machine learning paradigm that enables multiple clients to collaboratively train a model without sharing their data. In real-world scenarios, however, clients often…

Machine Learning · Computer Science 2025-10-17 Maulidi Adi Prasetia , Muhamad Risqi U. Saputra , Guntur Dharma Putra