English
Related papers

Related papers: Text-Guided Attention is All You Need for Zero-Sho…

200 papers

Vision-language models (VLMs), such as CLIP, have gained significant popularity as foundation models, with numerous fine-tuning methods developed to enhance performance on downstream tasks. However, due to their inherent vulnerability and…

Machine Learning · Computer Science 2025-08-28 Lijun Sheng , Jian Liang , Zilei Wang , Ran He

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalizability across diverse downstream tasks. However, recent studies have revealed that VLMs, including CLIP, are highly vulnerable to adversarial…

Cryptography and Security · Computer Science 2025-10-27 Jia Deng , Jin Li , Zhenhua Zhao , Shaowei Wang

Despite its prevalent use in image-text matching tasks in a zero-shot manner, CLIP has been shown to be highly vulnerable to adversarial perturbations added onto images. Recent studies propose to finetune the vision encoder of CLIP with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Songlong Xing , Zhengyu Zhao , Nicu Sebe

Efficient fine-tuning of vision-language models (VLMs) like CLIP for specific downstream tasks is gaining significant attention. Previous works primarily focus on prompt learning to adapt the CLIP into a variety of downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Jinlong Li , Dong Zhao , Zequn Jie , Elisa Ricci , Lin Ma , Nicu Sebe

Deep Learning (DL) is undergoing a paradigm shift with the emergence of foundation models. In this work, we focus on Contrastive Language-Image Pre-training (CLIP), a Vision-Language foundation model that achieves high accuracy across…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Angelos Zavras , Dimitrios Michail , Begüm Demir , Ioannis Papoutsis

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Most of the existing Zero-Shot Learning (ZSL) methods focus on learning a compatibility function between the image representation and class attributes. Few others concentrate on learning image representation combining local and global…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Faisal Alamri , Anjan Dutta

Vision-language models (VLMs) such as CLIP have demonstrated remarkable zero-shot generalization, yet remain highly vulnerable to adversarial examples (AEs). While test-time defenses are promising, existing methods fail to provide…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Sen Nie , Jie Zhang , Zhuo Wang , Shiguang Shan , Xilin Chen

Test-time adaptation (TTA) of visual language models has recently attracted significant attention as a solution to the performance degradation caused by distribution shifts in downstream tasks. However, existing cache-based TTA methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haotian Zhai , Xinyu Chen , Can Zhang , Tianming Sha , Ruirui Li

Transductive zero-shot learning with vision-language models leverages image-image similarities within the dataset to achieve better classification accuracy compared to the inductive setting. However, there is little work that explores the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Oindrila Saha , Logan Lawrence , Grant Van Horn , Subhransu Maji

Pretrained vision-language models (VLMs), such as CLIP, achieve remarkable zero-shot performance, yet their downstream potential hinges on effective fine-tuning. Most adaptation methods typically focus on refining representation from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Liang Chen , Ghazi Shazan Ahmad , Tianjun Yao , Lingqiao Liu , Zhiqiang Shen

Despite their impressive zero-shot abilities, vision-language models such as CLIP have been shown to be susceptible to adversarial attacks. To enhance its adversarial robustness, recent studies finetune the pretrained vision encoder of CLIP…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Songlong Xing , Weijie Wang , Zhengyu Zhao , Jindong Gu , Philip Torr , Nicu Sebe

Contrastive Language-Image Pretraining has demonstrated remarkable zero-shot generalization by aligning visual and textual modalities in a shared embedding space. However, when continuously fine-tuned on diverse tasks, CLIP suffers from…

Machine Learning · Computer Science 2025-07-29 Tiantian Peng , Yuyang Liu , Shuo Yang , Qiuhe Hong , YongHong Tian

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Vision-language models (VLMs) like CLIP have shown impressive generalization capabilities, yet their potential for Cross-Domain Few-Shot Learning (CDFSL) remains underexplored, where the model needs to transfer source-domain information to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

CLIP achieves strong zero-shot image-text retrieval by aligning global vision and text representations, yet it falls behind on fine-grained tasks even when fine-tuned on long, detailed captions. In this work, we propose $\beta$-CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Fatimah Zohra , Chen Zhao , Hani Itani , Bernard Ghanem

Test-time adaptation (TTA) of Vision-Language Models (VLMs) has emerged as a technique for tackling distribution shifts during the test time. Recent research indicates that the test-time adaptation is intrinsically linked to the model's…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Aodi Li , Liansheng Zhuang , Xiao Long , Houqiang Li , Shafei Wang

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are highly local,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Yang Liu , Lei Zhou , Xiao Bai , Yifei Huang , Lin Gu , Jun Zhou , Tatsuya Harada