English
Related papers

Related papers: Training Heterogeneous Client Models using Knowled…

200 papers

Federated Learning (FL) is a machine learning paradigm that enables the training of a shared global model across distributed clients while keeping the training data local. While most prior work on designing systems for FL has focused on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-21 Mohamed Elzohairy , Mohak Chadha , Anshul Jindal , Andreas Grafberger , Jianfeng Gu , Michael Gerndt , Osama Abboud

Federated Learning (FL) is an emerging machine learning paradigm that enables the collaborative training of a shared global model across distributed clients while keeping the data decentralized. Recent works on designing systems for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Mohak Chadha , Alexander Jensen , Jianfeng Gu , Osama Abboud , Michael Gerndt

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by…

Machine Learning · Computer Science 2021-03-30 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Heterogeneous Federated Learning (HFL) has gained significant attention for its capacity to handle both model and data heterogeneity across clients. Prototype-based HFL methods emerge as a promising solution to address statistical and model…

Machine Learning · Computer Science 2025-12-22 Fatema Siddika , Md Anwar Hossen , Wensheng Zhang , Anuj Sharma , Juan Pablo Muñoz , Ali Jannesari

Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using…

Machine Learning · Computer Science 2024-06-04 Pengchao Han , Xingyan Shi , Jianwei Huang

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Federated learning (FL) offers a privacy-preserving framework for distributed machine learning, enabling collaborative model training across diverse clients without centralizing sensitive data. However, statistical heterogeneity,…

Machine Learning · Statistics 2025-04-08 Hengrui Hu , Anai N. Kothari , Anjishnu Banerjee

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated learning (FL) is an emerging technique used to collaboratively train a global machine learning model while keeping the data localized on the user devices. The main obstacle to FL's practical implementation is the Non-Independent…

Machine Learning · Computer Science 2022-08-01 Hiep Nguyen , Lam Phan , Harikrishna Warrier , Yogesh Gupta

Federated Learning (FL) has emerged as a prominent alternative to the traditional centralized learning approach. Generally speaking, FL is a decentralized approach that allows for collaborative training of Machine Learning (ML) models…

Machine Learning · Computer Science 2024-03-19 S. Jamal Seyedmohammadi , S. Kawa Atapour , Jamshid Abouei , Arash Mohammadi

Federated Learning (FL) recently emerges as a paradigm to train a global machine learning model across distributed clients without sharing raw data. Knowledge Graph (KG) embedding represents KGs in a continuous vector space, serving as the…

Machine Learning · Computer Science 2023-02-28 Xiangrong Zhu , Guangyao Li , Wei Hu

Most current federated learning frameworks are modeled as static processes, ignoring the dynamic characteristics of the learning system. Under the limited communication budget of the central server, the flexible model architecture of a…

Machine Learning · Computer Science 2025-03-11 Yiting Zheng , Bohan Lin , Jinqian Chen , Jihua Zhu

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Federated learning (FL) is a distributed machine learning paradigm where multiple clients conduct local training based on their private data, then the updated models are sent to a central server for global aggregation. The practical…

Machine Learning · Computer Science 2025-04-03 Harsh Vardhan , Xiaofan Yu , Tajana Rosing , Arya Mazumdar

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the…

Machine Learning · Computer Science 2022-01-25 Chen Wu , Sencun Zhu , Prasenjit Mitra

In real-world applications, Federated Learning (FL) meets two challenges: (1) scalability, especially when applied to massive IoT networks; and (2) how to be robust against an environment with heterogeneous data. Realizing the first…

Machine Learning · Computer Science 2022-10-03 Minh-Duong Nguyen , Quoc-Viet Pham , Dinh Thai Hoang , Long Tran-Thanh , Diep N. Nguyen , Won-Joo Hwang