English
Related papers

Related papers: Learning Critically: Selective Self Distillation i…

200 papers

Federated learning (FL) enables a set of distributed clients to jointly train machine learning models while preserving their local data privacy, making it attractive for applications in healthcare, finance, mobility, and smart-city systems.…

Machine Learning · Computer Science 2026-03-26 Eman M. AbouNassar , Amr Elshall , Sameh Abdulah

In heterogeneous scenarios where the data distribution amongst the Federated Learning (FL) participants is Non-Independent and Identically distributed (Non-IID), FL suffers from the well known problem of data heterogeneity. This leads the…

Machine Learning · Computer Science 2024-07-09 Fatima Abacha , Sin G. Teo , Lucas C. Cordeiro , Mustafa A. Mustafa

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

Machine Learning · Computer Science 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients. Federated distillation (FD), built…

Machine Learning · Computer Science 2023-12-18 Jiawei Shao , Fangzhao Wu , Jun Zhang

Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-08 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Federated learning (FL) enables privacy-preserving collaborative model training without direct data sharing. Model-heterogeneous FL (MHFL) extends this paradigm by allowing clients to train personalized models with heterogeneous…

Machine Learning · Computer Science 2026-03-13 Ziqiao Weng , Weidong Cai , Bo Zhou

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

Machine Learning · Computer Science 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

Federated Learning (FL) is a distributed learning paradigm that enables a large number of resource-limited nodes to collaboratively train a model without data sharing. The non-independent-and-identically-distributed (non-i.i.d.) data…

Machine Learning · Computer Science 2022-02-04 Hongda Wu , Ping Wang

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

Machine Learning · Computer Science 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen

Federated learning (FL) has emerged as a transformative training paradigm, particularly invaluable in privacy-sensitive domains like healthcare. However, client heterogeneity in data, computing power, and tasks poses a significant…

Machine Learning · Computer Science 2024-10-01 Huidong Tang , Chen Li , Huachong Yu , Sayaka Kamei , Yasuhiko Morimoto

Federated Learning(FL) is popular as a privacy-preserving machine learning paradigm for generating a single model on decentralized data. However, statistical heterogeneity poses a significant challenge for FL. As a subfield of FL,…

Machine Learning · Computer Science 2024-10-22 Keting Yin , Jiayi Mao

In federated learning, a strong global model is collaboratively learned by aggregating clients' locally trained models. Although this precludes the need to access clients' data directly, the global model's convergence often suffers from…

Machine Learning · Computer Science 2022-11-30 Gihun Lee , Minchan Jeong , Yongjin Shin , Sangmin Bae , Se-Young Yun

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

Machine Learning · Computer Science 2024-01-02 Venkataraman Natarajan Iyer

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Federated Learning (FL) is a decentralized machine learning protocol that allows a set of participating agents to collaboratively train a model without sharing their data. This makes FL particularly suitable for settings where data privacy…

Machine Learning · Computer Science 2020-10-30 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu