English
Related papers

Related papers: Harmonizing Generalization and Personalization in …

200 papers

Vision Transformers (ViT) and Visual Prompt Tuning (VPT) achieve state-of-the-art performance with improved efficiency in various computer vision tasks. This suggests a promising paradigm shift of adapting pre-trained ViT models to…

Machine Learning · Computer Science 2024-02-27 Wenlong Deng , Christos Thrampoulidis , Xiaoxiao Li

In federated learning, textual prompt tuning adapts Vision-Language Models (e.g., CLIP) by tuning lightweight input tokens (or prompts) on local client data, while keeping network weights frozen. After training, only the prompts are shared…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Mainak Singha , Subhankar Roy , Sarthak Mehrotra , Ankit Jha , Moloud Abdar , Biplab Banerjee , Elisa Ricci

Remote sensing data is often distributed across multiple institutions, and due to privacy concerns and data-sharing restrictions, leveraging large-scale datasets in a centralized training framework is challenging. Federated learning offers…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Hui Lin , Chao Zhang , Danfeng Hong , Kexin Dong , Congcong Wen

Federated Graph Learning (FGL) aims to collaboratively and privately optimize graph models on divergent data for different tasks. A critical challenge in FGL is to enable effective yet efficient federated optimization against multifaceted…

Machine Learning · Computer Science 2024-11-05 Zhuoning Guo , Ruiqian Han , Hao Liu

Integrating pretrained vision-language foundation models like CLIP into federated learning has attracted significant attention for enhancing generalization across diverse tasks. Typically, federated learning of vision-language models…

Machine Learning · Computer Science 2024-10-01 Bikang Pan , Wei Huang , Ye Shi

Federated Learning (FL) is designed as a decentralized, privacy-preserving machine learning paradigm that enables multiple clients to collaboratively train a model without sharing their data. In real-world scenarios, however, clients often…

Machine Learning · Computer Science 2025-10-17 Maulidi Adi Prasetia , Muhamad Risqi U. Saputra , Guntur Dharma Putra

Federated learning aims to learn a global model that performs well on client devices with limited cross-client communication. Personalized federated learning (PFL) further extends this setup to handle data heterogeneity between clients by…

Machine Learning · Computer Science 2021-10-27 Idan Achituve , Aviv Shamsian , Aviv Navon , Gal Chechik , Ethan Fetaya

Prompt learning has propelled vision-language models like CLIP to excel in diverse tasks, making them ideal for federated learning due to computational efficiency. However, conventional approaches that rely solely on final-layer features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Suraj Prasad , Navyansh Mahla , Sunny Gupta , Amit Sethi

Prompt learning for vision-language models, e.g., CoOp, has shown great success in adapting CLIP to different downstream tasks, making it a promising solution for federated learning due to computational reasons. Existing prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Chen Qiu , Xingyu Li , Chaithanya Kumar Mummadi , Madan Ravi Ganesh , Zhenzhen Li , Lu Peng , Wan-Yi Lin

Federated prototype learning (FPL), as a solution to heterogeneous federated learning (HFL), effectively alleviates the challenges of data and model heterogeneity.However, existing FPL methods fail to balance the fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ningzhi Gao , Siquan Huang , Leyu Shi , Ying Gao

In traditional Federated Learning approaches like FedAvg, the global model underperforms when faced with data heterogeneity. Personalized Federated Learning (PFL) enables clients to train personalized models to fit their local data…

Machine Learning · Computer Science 2024-07-24 Xinghao Wu , Jianwei Niu , Xuefeng Liu , Mingjia Shi , Guogang Zhu , Shaojie Tang

Despite the remarkable performance of deep models in medical imaging, they still require source data for training, which limits their potential in light of privacy concerns. Federated learning (FL), as a decentralized learning framework…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihang Wu , Ahmad Chaddad

The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while maintaining data privacy. However, current PFL techniques…

Machine Learning · Computer Science 2023-05-03 Yue Wu , Shuaicheng Zhang , Wenchao Yu , Yanchi Liu , Quanquan Gu , Dawei Zhou , Haifeng Chen , Wei Cheng

In recent years, Federated Graph Learning (FGL) has gained significant attention for its distributed training capabilities in graph-based machine intelligence applications, mitigating data silos while offering a new perspective for…

Machine Learning · Computer Science 2025-04-15 Zhengyu Wu , Xunkai Li , Yinlin Zhu , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Pre-trained language models (PLM) have revolutionized the NLP landscape, achieving stellar performances across diverse tasks. These models, while benefiting from vast training data, often require fine-tuning on specific data to cater to…

Computation and Language · Computer Science 2023-10-04 Jingwei Sun , Ziyue Xu , Hongxu Yin , Dong Yang , Daguang Xu , Yiran Chen , Holger R. Roth

Text summarization is essential for information aggregation and demands large amounts of training data. However, concerns about data privacy and security limit data collection and model training. To eliminate this concern, we propose a…

Artificial Intelligence · Computer Science 2023-04-25 Rongfeng Pan , Jianzong Wang , Lingwei Kong , Zhangcheng Huang , Jing Xiao

Federated Prototype Learning (FedPL) has emerged as an effective strategy for handling data heterogeneity in Federated Learning (FL). In FedPL, clients collaboratively construct a set of global feature centers (prototypes), and let local…

Machine Learning · Computer Science 2026-04-20 Xinghao Wu , Jianwei Niu , Xuefeng Liu , Guogang Zhu , Jiayuan Zhang , Shaojie Tang , Wei Chen

Federated learning (FL) is a privacy-preserving machine learning paradigm that enables collaborative model training across multiple distributed clients without disclosing their raw data. Personalized federated learning (pFL) has gained…

Machine Learning · Computer Science 2025-08-28 Tiandi Ye , Wenyan Liu , Kai Yao , Lichun Li , Shangchao Su , Cen Chen , Xiang Li , Shan Yin , Ming Gao

Federated learning has received significant attention for its ability to simultaneously protect customer privacy and leverage distributed data from multiple devices for model training. However, conventional approaches often focus on…

Machine Learning · Computer Science 2025-10-07 Jiahao Zeng , Wolong Xing , Liangtao Shi , Xin Huang , Jialin Wang , Zhile Cao , Zhenkui Shi

Personalised federated learning (FL) aims at collaboratively learning a machine learning model taylored for each client. Albeit promising advances have been made in this direction, most of existing approaches works do not allow for…

Machine Learning · Computer Science 2023-01-30 Nikita Kotelevskii , Maxime Vono , Eric Moulines , Alain Durmus