English
Related papers

Related papers: Leveraging Foundation Models for Efficient Federat…

200 papers

Federated learning (FL) enables wireless terminals to collaboratively learn a shared parameter model while keeping all the training data on devices per se. Parameter sharing consists of synchronous and asynchronous ways: the former…

Information Theory · Computer Science 2024-01-17 Haihui Xie , Minghua Xia , Peiran Wu , Shuai Wang , Kaibin Huang

Federated Learning (FL) enables collaborative model training across decentralized clients without sharing private data. However, FL suffers from biased global models due to non-IID and long-tail data distributions. We propose…

Machine Learning · Computer Science 2026-01-08 Jingrui Zhang , Yimeng Xu , Shujie Li , Feng Liang , Haihan Duan , Yanjie Dong , Victor C. M. Leung , Xiping Hu

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Federated Edge Learning (FEEL) is a promising distributed learning technique that aims to train a shared global model while reducing communication costs and promoting users' privacy. However, the training process might significantly occupy…

Networking and Internet Architecture · Computer Science 2022-03-10 Boubakr Nour , Soumaya Cherkaoui

Large-scale Internet of Things (IoT) networks enable intelligent services such as smart cities and autonomous driving, but often face resource constraints. Collecting heterogeneous sensory data, especially in small-scale datasets, is…

Machine Learning · Computer Science 2026-04-14 Haihui Xie , Wenkun Wen , Shuwu Chen , Zhaogang Shu , Minghua Xia

Federated split learning (FedSL) has emerged as a promising paradigm for enabling collaborative intelligence in industrial Internet of Things (IoT) systems, particularly in smart factories where data privacy, communication efficiency, and…

Robotics · Computer Science 2025-10-08 Wanli Ni , Hui Tian , Shuai Wang , Chengyang Li , Lei Sun , Zhaohui Yang

Learning from the collective knowledge of data dispersed across private sources can provide neural networks with enhanced generalization capabilities. Federated learning, a method for collaboratively training a machine learning model across…

Machine Learning · Computer Science 2024-05-20 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

Machine Learning · Computer Science 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

In many applications of federated learning (FL), clients desire models that are personalized using their local data, yet are also robust in the sense that they retain general global knowledge. However, the presence of data heterogeneity…

Machine Learning · Computer Science 2023-10-10 Liam Collins , Shanshan Wu , Sewoong Oh , Khe Chai Sim

Pre-trained language models (PLM) have revolutionized the NLP landscape, achieving stellar performances across diverse tasks. These models, while benefiting from vast training data, often require fine-tuning on specific data to cater to…

Computation and Language · Computer Science 2023-10-04 Jingwei Sun , Ziyue Xu , Hongxu Yin , Dong Yang , Daguang Xu , Yiran Chen , Holger R. Roth

Federated Learning (FL) with pre-trained Vision-Language Models (VLMs) has emerged as a promising paradigm for various downstream tasks. By leveraging its strong representations, recent studies improve task adaptation under insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yuting Ma , Lechao Cheng , Xiaohua Xu

Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share local model…

Machine Learning · Computer Science 2023-12-25 Xuan Gong , Shanglin Li , Yuxiang Bao , Barry Yao , Yawen Huang , Ziyan Wu , Baochang Zhang , Yefeng Zheng , David Doermann

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Federated learning (FL) effectively mitigates the data silo challenge brought about by policies and privacy concerns, implicitly harnessing more data for deep model training. However, traditional centralized FL models grapple with diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Li Lin , Yixiang Liu , Jiewei Wu , Pujin Cheng , Zhiyuan Cai , Kenneth K. Y. Wong , Xiaoying Tang

Federated domain generalization (FedDG) aims to improve the global model generalization in unseen domains by addressing data heterogeneity under privacy-preserving constraints. A common strategy in existing FedDG studies involves sharing…

Artificial Intelligence · Computer Science 2024-11-18 Shuai Gong , Chaoran Cui , Chunyun Zhang , Wenna Wang , Xiushan Nie , Lei Zhu

Federated learning is a decentralized approach for training models on distributed devices, by summarizing local changes and sending aggregate parameters from local models to the cloud rather than the data itself. In this research we employ…

Machine Learning · Computer Science 2020-08-19 Joel Stremmel , Arjun Singh

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

Federated learning (FL) is an emerging machine learning paradigm that allows to accomplish model training without aggregating data at a central server. Most studies on FL consider a centralized framework, in which a single server is endowed…

Machine Learning · Computer Science 2023-03-22 Bin Wang , Jun Fang , Hongbin Li , Xiaojun Yuan , Qing Ling

Federated learning (FL) supports distributed training of a global machine learning model across multiple devices with the help of a central server. However, data heterogeneity across different devices leads to the client model drift issue…

Machine Learning · Computer Science 2023-10-06 Xu Zhou , Xinyu Lei , Cong Yang , Yichun Shi , Xiao Zhang , Jingwen Shi

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi