English
Related papers

Related papers: Federated Domain Generalization with Domain-specif…

200 papers

Federated domain generalization (FedDG) aims to learn a globally generalizable model from decentralized clients with heterogeneous data while preserving privacy. Recent studies have introduced prompt learning to adapt vision-language models…

Machine Learning · Computer Science 2025-05-01 Shuai Gong , Chaoran Cui , Xiaolin Dong , Xiushan Nie , Lei Zhu , Xiaojun Chang

Conventional federated learning (FL) assumes a closed world with a fixed total number of clients. In contrast, new clients continuously join the FL process in real-world scenarios, introducing new knowledge. This raises two critical…

Machine Learning · Computer Science 2025-10-21 Zhengyi Zhong , Wenzheng Jiang , Weidong Bao , Ji Wang , Cheems Wang , Guanbo Wang , Yongheng Deng , Ju Ren

Source-Free Domain Generalization (SFDG) aims to develop a model that works for unseen target domains without relying on any source domain. Research in SFDG primarily bulids upon the existing knowledge of large-scale vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yunlong Tang , Yuxuan Wan , Lei Qi , Xin Geng

Foundation models (FMs) have shown prominent success in a wide range of tasks. Their applicability to specific domain-task pairings relies on the availability of, both, high-quality data and significant computational resources. These…

Machine Learning · Computer Science 2023-11-10 Lekang Jiang , Filip Svoboda , Nicholas D. Lane

Domain generalization (DG) has been a hot topic in image recognition, with a goal to train a general model that can perform well on unseen domains. Recently, federated learning (FL), an emerging machine learning paradigm to train a global…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Junming Chen , Meirui Jiang , Qi Dou , Qifeng Chen

Source-free domain generalization (SFDG) tackles the challenge of adapting models to unseen target domains without access to source domain data. To deal with this challenging task, recent advances in SFDG have primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Haoran Zhang , Shuanghao Bai , Wanqi Zhou , Jingwen Fu , Badong Chen

The source-free cross-domain few-shot learning (CD-FSL) task aims to transfer pretrained models to target domains utilizing minimal samples, eliminating the need for source domain data. Addressing this issue requires models to have robust…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Linhai Zhuo , Zheng Wang , Yuqian Fu , Tianwen Qian

Prompt tuning for vision-language models such as CLIP involves optimizing the text prompts used to generate image-text pairs for specific downstream tasks. While hand-crafted or template-based prompts are generally applicable to a wider…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Zhang

Domain generalization (DG) attempts to generalize a model trained on single or multiple source domains to the unseen target domain. Benefiting from the success of Visual-and-Language Pre-trained models in recent years, we argue that it is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Geng Liu , Yuxi Wang

Fine-tuning pre-trained models is a popular approach in machine learning for solving complex tasks with moderate data. However, fine-tuning the entire pre-trained model is ineffective in federated data scenarios where local data…

Machine Learning · Computer Science 2025-02-28 Pei-Yau Weng , Minh Hoang , Lam M. Nguyen , My T. Thai , Tsui-Wei Weng , Trong Nghia Hoang

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

To ensure the out-of-distribution (OOD) generalization performance, traditional domain generalization (DG) methods resort to training on data from multiple sources with different underlying distributions. And the success of those DG methods…

Machine Learning · Computer Science 2023-05-26 Zheyan Shen , Han Yu , Peng Cui , Jiashuo Liu , Xingxuan Zhang , Linjun Zhou , Furui Liu

Transformer-based pre-trained models have emerged as the predominant solution for natural language processing (NLP). Fine-tuning such pre-trained models for downstream tasks often requires a considerable amount of labeled private data. In…

Computation and Language · Computer Science 2023-08-22 Dongqi Cai , Yaozong Wu , Haitao Yuan , Shangguang Wang , Felix Xiaozhu Lin , Mengwei Xu

Prompt learning has emerged as an efficient alternative for fine-tuning foundational models, such as CLIP, for various downstream tasks. Conventionally trained using the task-specific objective, i.e., cross-entropy loss, prompts tend to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Muhammad Uzair Khattak , Syed Talal Wasim , Muzammal Naseer , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

This study addresses the generalization limitations commonly observed in large language models under multi-task and cross-domain settings. Unlike prior methods such as SPoT, which depends on fixed prompt templates, our study introduces a…

Computation and Language · Computer Science 2025-09-24 Xin Hu , Yue Kang , Guanzi Yao , Tianze Kang , Mengjie Wang , Heyao Liu

In traditional Federated Learning approaches like FedAvg, the global model underperforms when faced with data heterogeneity. Personalized Federated Learning (PFL) enables clients to train personalized models to fit their local data…

Machine Learning · Computer Science 2024-07-24 Xinghao Wu , Jianwei Niu , Xuefeng Liu , Mingjia Shi , Guogang Zhu , Shaojie Tang

Today's scene graph generation (SGG) models typically require abundant manual annotations to learn new predicate types. Therefore, it is difficult to apply them to real-world applications with massive uncommon predicate categories whose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xingchen Li , Jun Xiao , Guikun Chen , Yinfu Feng , Yi Yang , An-an Liu , Long Chen

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

Computation and Language · Computer Science 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

Domain generalization (DG) based Face Anti-Spoofing (FAS) aims to improve the model's performance on unseen domains. Existing methods either rely on domain labels to align domain-invariant feature spaces, or disentangle generalizable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Ajian Liu , Shuai Xue , Jianwen Gan , Jun Wan , Yanyan Liang , Jiankang Deng , Sergio Escalera , Zhen Lei

Federated Learning (FL) is a distributed machine learning scheme in which clients jointly participate in the collaborative training of a global model by sharing model information rather than their private datasets. In light of concerns…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Yexuan Fu , Renrong Shao , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu