English
Related papers

Related papers: An Upload-Efficient Scheme for Transferring Knowle…

200 papers

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often…

Machine Learning · Computer Science 2024-03-05 Wei Guo , Fuzhen Zhuang , Xiao Zhang , Yiqi Tong , Jin Dong

Recent research in federated large language models (LLMs) has primarily focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on transferring knowledge from server-based LLMs to small language…

Computation and Language · Computer Science 2024-12-17 Tao Fan , Guoqiang Ma , Yan Kang , Hanlin Gu , Yuanfeng Song , Lixin Fan , Kai Chen , Qiang Yang

Federated learning (FL) has been recognized as a privacy-preserving distributed machine learning paradigm that enables knowledge sharing among various heterogeneous artificial intelligence (AIoT) devices through centralized global model…

Machine Learning · Computer Science 2022-12-06 Jun Xia , Yi Zhang , Zhihao Yue , Ming Hu , Xian Wei , Mingsong Chen

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic…

Machine Learning · Computer Science 2025-01-29 Xi Chen , Qin Li , Haibin Cai , Ting Wang

Federated Learning (FL) has emerged as a promising paradigm for privacy-preserving collaborative learning, yet data heterogeneity remains a critical challenge. While existing methods achieve progress in addressing data heterogeneity for…

Machine Learning · Computer Science 2025-08-19 Yuhao Zhou , Jindi Lv , Yuxin Tian , Dan Si , Qing Ye , Jiancheng Lv

Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and…

Machine Learning · Computer Science 2022-01-24 Or Litany , Haggai Maron , David Acuna , Jan Kautz , Gal Chechik , Sanja Fidler

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated learning (FL) enables multiple clients to train models collaboratively without sharing local data, which has achieved promising results in different areas, including the Internet of Things (IoT). However, end IoT devices do not…

Machine Learning · Computer Science 2023-03-07 Jiaqi Wang , Shenglai Zeng , Zewei Long , Yaqing Wang , Houping Xiao , Fenglong Ma

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

In recent years, One-shot Federated Learning methods based on Diffusion Models have garnered increasing attention due to their remarkable performance. However, most of these methods require the deployment of foundation models on client…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mingzhao Yang , Shangchao Su , Bin Li , Xiangyang Xue

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated Learning (FL) enables joint training across distributed clients using their local data privately. Federated Multi-Task Learning (FMTL) builds on FL to handle multiple tasks, assuming model congruity that identical model…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Yuxiang Lu , Suizhi Huang , Yuwen Yang , Shalayiding Sirejiding , Yue Ding , Hongtao Lu

The growing interest in intelligent services and privacy protection for mobile devices has given rise to the widespread application of federated learning in Multi-access Edge Computing (MEC). Diverse user behaviors call for personalized…

Machine Learning · Computer Science 2025-02-28 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Quyang Pan , Xuefeng Jiang , Bo Gao

Federated learning is a distributed machine learning paradigm through centralized model aggregation. However, standard federated learning relies on a centralized server, making it vulnerable to server failures. While existing solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-03 Hongliang Zhang , Fenghua Xu , Zhongyuan Yu , Shanchen Pang , Chunqiang Hu , Jiguo Yu

Federated learning (FL) allows multiple clients to collaboratively train a deep learning model. One major challenge of FL is when data distribution is heterogeneous, i.e., differs from one client to another. Existing personalized FL…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Haolin Yuan , Bo Hui , Yuchen Yang , Philippe Burlina , Neil Zhenqiang Gong , Yinzhi Cao

In this paper, we investigate the problem of decentralized federated learning (DFL) in Internet of things (IoT) systems, where a number of IoT clients train models collectively for a common task without sharing their private training data…

Machine Learning · Computer Science 2021-05-13 Chengxi Li , Gang Li , Pramod K. Varshney

Collaborative fairness is a crucial challenge in federated learning. However, existing approaches often overlook a practical yet complex form of heterogeneity: imbalanced covariate shift. We provide a theoretical analysis of this setting,…

Machine Learning · Computer Science 2025-07-14 Tianrun Yu , Jiaqi Wang , Haoyu Wang , Mingquan Lin , Han Liu , Nelson S. Yee , Fenglong Ma