English
Related papers

Related papers: Prompt Vision Transformer for Domain Generalizatio…

200 papers

Prompts have been proven to play a crucial role in large language models, and in recent years, vision models have also been using prompts to improve scalability for multiple downstream tasks. In this paper, we focus on adapting prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Zhenxiang Xiao , Yuzhong Chen , Lu Zhang , Junjie Yao , Zihao Wu , Xiaowei Yu , Yi Pan , Lin Zhao , Chong Ma , Xinyu Liu , Wei Liu , Xiang Li , Yixuan Yuan , Dinggang Shen , Dajiang Zhu , Tianming Liu , Xi Jiang

Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yulu Gan , Yan Bai , Yihang Lou , Xianzheng Ma , Renrui Zhang , Nian Shi , Lin Luo

In real-world applications, the sample distribution at the inference stage often differs from the one at the training stage, causing performance degradation of trained deep models. The research on domain generalization (DG) aims to develop…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiao Zhang , Jian Xu , Xu-Yao Zhang , Cheng-Lin Liu

In real-world visual recognition problems, the assumption that the training data (source domain) and test data (target domain) are sampled from the same distribution is often violated. This is known as the domain adaptation problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Hongyu Xu , Jingjing Zheng , Azadeh Alavi , Rama Chellappa

While originally designed for image generation, diffusion models have recently shown to provide excellent pretrained feature representations for semantic segmentation. Intrigued by this result, we set out to explore how well…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Rui Gong , Martin Danelljan , Han Sun , Julio Delgado Mangas , Luc Van Gool

Deep Metric Learning (DML) has long attracted the attention of the machine learning community as a key objective. Existing solutions concentrate on fine-tuning the pre-trained models on conventional image datasets. As a result of the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Li Ren , Chen Chen , Liqiang Wang , Kien Hua

Conventional Domain Adaptation (DA) methods aim to learn domain-invariant feature representations to improve the target adaptation performance. However, we motivate that domain-specificity is equally important since in-domain trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Sunandini Sanyal , Ashish Ramayee Asokan , Suvaansh Bhambri , Akshay Kulkarni , Jogendra Nath Kundu , R. Venkatesh Babu

Recent domain generalized semantic segmentation (DGSS) studies have achieved notable improvements by distilling semantic knowledge from Vision-Language Models (VLMs). However, they overlook the semantic misalignment between visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Seogkyu Jeon , Kibeom Hong , Hyeran Byun

Large pre-trained vision language models (VLMs) have shown impressive zero-shot ability on downstream tasks with manually designed prompt. To further adapt VLMs to downstream tasks, soft prompt is proposed to replace manually designed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Shuanghao Bai , Yuedi Zhang , Wanqi Zhou , Zhirong Luan , Badong Chen

Large pre-trained vision-language models like CLIP have transformed computer vision by aligning images and text in a shared feature space, enabling robust zero-shot transfer via prompting. Soft-prompting, such as Context Optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many distribution shifts and, therefore, should substantially improve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Xin Zhang , Shixiang Shane Gu , Yutaka Matsuo , Yusuke Iwasawa

Visual prompt tuning (VPT) is a promising solution incorporating learnable prompt tokens to customize pre-trained models for downstream tasks. However, VPT and its variants often encounter challenges like prompt initialization, prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yuzhu Wang , Lechao Cheng , Chaowei Fang , Dingwen Zhang , Manni Duan , Meng Wang

Cross-domain few-shot learning (CDFSL) aims to transfer knowledge from a data-sufficient source domain to data-scarce target domains. Although Vision Transformer (ViT) has shown superior capability in many vision tasks, its transferability…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Recent advancements in pre-trained Vision-Language Models (VLMs) have highlighted the significant potential of prompt tuning for adapting these models to a wide range of downstream tasks. However, existing prompt tuning methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xinyang Wang , Yi Yang , Minfeng Zhu , Kecheng Zheng , Shi Liu , Wei Chen

Fully test-time adaptation aims to adapt the network model based on sequential analysis of input samples during the inference stage to address the cross-domain performance degradation problem of deep neural networks. This work is based on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yushun Tang , Shuoshuo Chen , Zhehan Kan , Yi Zhang , Qinghai Guo , Zhihai He

Visual Prompt Tuning (VPT) has proven effective for parameter-efficient adaptation of pre-trained vision models to downstream tasks by inserting task-specific learnable prompt tokens. Despite its empirical success, a comprehensive…

Machine Learning · Computer Science 2026-02-12 Minh Le , Anh Nguyen , Huy Nguyen , Chau Nguyen , Anh Tran , Nhat Ho

Single-domain generalization aims to learn a model from single source domain data to achieve generalized performance on other unseen target domains. Existing works primarily focus on improving the generalization ability of static networks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Deng Li , Aming Wu , Yaowei Wang , Yahong Han

Prototypical part network (ProtoPNet) has drawn wide attention and boosted many follow-up studies due to its self-explanatory property for explainable artificial intelligence (XAI). However, when directly applying ProtoPNet on vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengqi Xue , Qihan Huang , Haofei Zhang , Jingwen Hu , Jie Song , Mingli Song , Canghong Jin

The large-scale pre-trained vision language models (VLM) have shown remarkable domain transfer capability on natural images. However, it remains unknown whether this capability can also apply to the medical image domain. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Ziyuan Qin , Huahui Yi , Qicheng Lao , Kang Li

Parameter efficient transfer learning (PETL) is an emerging research spot that aims to adapt large-scale pre-trained models to downstream tasks. Recent advances have achieved great success in saving storage and computation costs. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Chunqing Ruan , Hongjian Wang