English
Related papers

Related papers: Optimized Federated Knowledge Distillation with Di…

200 papers

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

Federated learning enables multiple clients to collaboratively learn a global model by periodically aggregating the clients' models without transferring the local data. However, due to the heterogeneity of the system and data, many…

Machine Learning · Computer Science 2021-09-14 Dezhong Yao , Wanning Pan , Yutong Dai , Yao Wan , Xiaofeng Ding , Hai Jin , Zheng Xu , Lichao Sun

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share local model…

Machine Learning · Computer Science 2023-12-25 Xuan Gong , Shanglin Li , Yuxiang Bao , Barry Yao , Yawen Huang , Ziyan Wu , Baochang Zhang , Yefeng Zheng , David Doermann

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

Machine Learning · Computer Science 2023-12-29 Ho Man Kwan , Shenghui Song

Federated Learning (FL) is a distributed machine learning paradigm which coordinates multiple clients to collaboratively train a global model via a central server. Sequential Federated Learning (SFL) is a newly-emerging FL training…

Machine Learning · Computer Science 2025-07-14 Haotian Xu , Jinrui Zhou , Xichong Zhang , Mingjun Xiao , He Sun , Yin Xu

The performance of federated learning in neural networks is generally influenced by the heterogeneity of the data distribution. For a well-performing global model, taking a weighted average of the local models, as done by most existing…

Machine Learning · Computer Science 2022-05-03 Xinjia Li , Boyu Chen , Wenlian Lu

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

Machine Learning · Computer Science 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

In real-world applications, Federated Learning (FL) meets two challenges: (1) scalability, especially when applied to massive IoT networks; and (2) how to be robust against an environment with heterogeneous data. Realizing the first…

Machine Learning · Computer Science 2022-10-03 Minh-Duong Nguyen , Quoc-Viet Pham , Dinh Thai Hoang , Long Tran-Thanh , Diep N. Nguyen , Won-Joo Hwang

Federated Learning (FL) has emerged as a prominent alternative to the traditional centralized learning approach. Generally speaking, FL is a decentralized approach that allows for collaborative training of Machine Learning (ML) models…

Machine Learning · Computer Science 2024-03-19 S. Jamal Seyedmohammadi , S. Kawa Atapour , Jamshid Abouei , Arash Mohammadi

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Federated Learning (FL) is a distributed and privacy-preserving machine learning paradigm that coordinates multiple clients to train a model while keeping the raw data localized. However, this traditional FL poses some challenges, including…

Machine Learning · Computer Science 2026-05-12 Laiqiao Qin , Tianqing Zhu , Wanlei Zhou , Philip S. Yu

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

As a promising distributed machine learning paradigm, Federated Learning (FL) trains a central model with decentralized data without compromising user privacy, which has made it widely used by Artificial Intelligence Internet of Things…

Machine Learning · Computer Science 2022-05-13 Tian Liu , Zhiwei Ling , Jun Xia , Xin Fu , Shui Yu , Mingsong Chen

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

Machine Learning · Computer Science 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications since patient data…