English
Related papers

Related papers: Open-Vocabulary Federated Learning with Multimodal…

200 papers

Vision-Language Models (VLMs) like CLIP have demonstrated remarkable generalization in zero- and few-shot settings, but adapting them efficiently to decentralized, heterogeneous data remains a challenge. While prompt tuning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Sajjad Ghiasvand , Mahnoosh Alizadeh , Ramtin Pedarsani

As Large Language Models (LLMs) push the boundaries of AI capabilities, their demand for data is growing. Much of this data is private and distributed across edge devices, making Federated Learning (FL) a de-facto alternative for…

Machine Learning · Computer Science 2024-08-22 Hanzi Mei , Dongqi Cai , Ao Zhou , Shangguang Wang , Mengwei Xu

In federated learning, textual prompt tuning adapts Vision-Language Models (e.g., CLIP) by tuning lightweight input tokens (or prompts) on local client data, while keeping network weights frozen. After training, only the prompts are shared…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Mainak Singha , Subhankar Roy , Sarthak Mehrotra , Ankit Jha , Moloud Abdar , Biplab Banerjee , Elisa Ricci

Federated learning has been predominantly concerned with collaborative training of deep networks from scratch, and especially the many challenges that arise, such as communication cost, robustness to heterogeneous data, and support for…

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding and generation by integrating visual and textual information. While instruction tuning and parameter-efficient fine-tuning methods have…

Machine Learning · Computer Science 2025-06-12 Weiying Zheng , Ziyue Lin , Pengxin Guo , Yuyin Zhou , Feifei Wang , Liangqiong Qu

Recently, federated learning (FL) has emerged as a promising distributed machine learning (ML) technology, owing to the advancing computational and sensing capacities of end-user devices, however with the increasing concerns on users'…

Machine Learning · Computer Science 2024-08-06 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Sha Wei , Fan Wu , Guihai Chen , Thilina Ranbaduge

Federated Learning (FL) is a machine learning technique that enables multiple entities to collaboratively learn a shared model without exchanging their local data. Over the past decade, FL systems have achieved substantial progress, scaling…

Machine Learning · Computer Science 2025-03-04 Katharine Daly , Hubert Eichner , Peter Kairouz , H. Brendan McMahan , Daniel Ramage , Zheng Xu

In federated learning (FL), accommodating clients with diverse resource constraints remains a significant challenge. A widely adopted approach is to use a shared full-size model, from which each client extracts a submodel aligned with its…

Machine Learning · Computer Science 2026-04-14 Wenfei Liang , Wee Peng Tay

Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a number of participants without sharing data. Recent works have begun to consider the effects of using pre-trained models as an initialization point…

Machine Learning · Computer Science 2023-11-07 Gwen Legate , Nicolas Bernier , Lucas Caccia , Edouard Oyallon , Eugene Belilovsky

Vertical Federated Learning (VFL), which has a broad range of real-world applications, has received much attention in both academia and industry. Enterprises aspire to exploit more valuable features of the same users from diverse…

Machine Learning · Computer Science 2024-05-22 Wenguo Li , Xinling Guo , Xu Jiao , Tiancheng Huang , Xiaoran Yan , Yao Yang

Federated Learning (FL) with pre-trained Vision-Language Models (VLMs) has emerged as a promising paradigm for various downstream tasks. By leveraging its strong representations, recent studies improve task adaptation under insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yuting Ma , Lechao Cheng , Xiaohua Xu

Federated learning (FL) is a machine learning field in which researchers try to facilitate model learning process among multiparty without violating privacy protection regulations. Considerable effort has been invested in FL optimization…

Machine Learning · Computer Science 2022-04-25 Dun Zeng , Siqi Liang , Xiangjing Hu , Hui Wang , Zenglin Xu

Multimodal learning has seen great success mining data features from multiple modalities with remarkable model performance improvement. Meanwhile, federated learning (FL) addresses the data sharing problem, enabling privacy-preserved…

Machine Learning · Computer Science 2023-03-29 Rongyu Zhang , Xiaowei Chi , Guiliang Liu , Wenyi Zhang , Yuan Du , Fangxin Wang

Despite the remarkable performance of deep models in medical imaging, they still require source data for training, which limits their potential in light of privacy concerns. Federated learning (FL), as a decentralized learning framework…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihang Wu , Ahmad Chaddad

Multimodal Large Language Models (MLLMs) excel in tasks like multimodal reasoning and cross-modal retrieval but face deployment challenges in real-world scenarios due to distributed multimodal data and strict privacy requirements. Federated…

Machine Learning · Computer Science 2025-06-19 Yao Zhang , Hewei Gao , Haokun Chen , Weiguo Li , Yunpu Ma , Volker Tresp

Over the past few years, Federated Learning (FL) has become an emerging machine learning technique to tackle data privacy challenges through collaborative training. In the Federated Learning algorithm, the clients submit a locally trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-22 Tiantian Feng , Digbalay Bose , Tuo Zhang , Rajat Hebbar , Anil Ramakrishna , Rahul Gupta , Mi Zhang , Salman Avestimehr , Shrikanth Narayanan

Federated learning (FL) has emerged as an effective technique to co-training machine learning models without actually sharing data and leaking privacy. However, most existing FL methods focus on the supervised setting and ignore the…

Machine Learning · Computer Science 2021-07-06 Zewei Long , Liwei Che , Yaqing Wang , Muchao Ye , Junyu Luo , Jinze Wu , Houping Xiao , Fenglong Ma

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

Federated learning aims to tackle the ``isolated data island" problem, where it trains a collective model from physically isolated clients while safeguarding the privacy of users' data. However, supervised federated learning necessitates…

Artificial Intelligence · Computer Science 2024-04-18 Hao Yan , Yuhong Guo