English
Related papers

Related papers: Improving Zero-Shot Generalization for CLIP with S…

200 papers

Contrastive vision-language models, such as CLIP, have garnered considerable attention for various downstream tasks, mainly due to the remarkable ability of the learned features for generalization. However, the features they learned often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Yichao Cai , Yuhang Liu , Zhen Zhang , Javen Qinfeng Shi

While vision-language models like CLIP have advanced zero-shot surgical phase recognition, they struggle with fine-grained surgical activities, especially action triplets. This limitation arises because current CLIP formulations rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-30 Saurav Sharma , Didier Mutter , Nicolas Padoy

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

Large-scale Pre-Training Vision-Language Model such as CLIP has demonstrated outstanding performance in zero-shot classification, e.g. achieving 76.3% top-1 accuracy on ImageNet without seeing any example, which leads to potential benefits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xuefeng Hu , Ke Zhang , Lu Xia , Albert Chen , Jiajia Luo , Yuyin Sun , Ken Wang , Nan Qiao , Xiao Zeng , Min Sun , Cheng-Hao Kuo , Ram Nevatia

Recently, CLIP has been applied to pixel-level zero-shot learning tasks via a two-stage scheme. The general idea is to first generate class-agnostic region proposals and then feed the cropped proposal regions to CLIP to utilize its…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ziqin Zhou , Bowen Zhang , Yinjie Lei , Lingqiao Liu , Yifan Liu

Vision-language models like CLIP have demonstrated remarkable zero-shot capabilities in classification and retrieval. However, these models often struggle with compositional reasoning - the ability to understand the relationships between…

Machine Learning · Computer Science 2025-10-29 Amit Peleg , Naman Deep Singh , Matthias Hein

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

With the advent of large-scale pre-trained models, interest in adapting and exploiting them for continual learning scenarios has grown. In this paper, we propose an approach to exploiting pre-trained vision-language models (e.g. CLIP) that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xialei Liu , Xusheng Cao , Haori Lu , Jia-wen Xiao , Andrew D. Bagdanov , Ming-Ming Cheng

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

Contrastive Language-Image Pre-training (CLIP) on large-scale image-caption datasets learns representations that can achieve remarkable zero-shot generalization. However, such models require a massive amount of pre-training data. Improving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Siddharth Joshi , Arnav Jain , Ali Payani , Baharan Mirzasoleiman

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

The Contrastive Language-Image Pre-training (CLIP) has recently shown remarkable generalization on "zero-shot" training and has applied to many downstream tasks. We explore the adaptation of CLIP to achieve a more efficient and generalized…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Qiang Wang , Junlong Du , Ke Yan , Shouhong Ding

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Zero-shot anomaly detection (ZSAD) aims to identify anomalies in unseen categories by leveraging CLIP's zero-shot capabilities to match text prompts with visual features. A key challenge in ZSAD is learning general prompts stably and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Donghyeong Kim , Chaewon Park , Suhwan Cho , Hyeonjeong Lim , Minseok Kang , Jungho Lee , Sangyoun Lee

The Contrastive Language-Image Pretraining (CLIP) model has been widely used in various downstream vision tasks. The few-shot learning paradigm has been widely adopted to augment its capacity for these tasks. However, current paradigms may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jintao Rong , Hao Chen , Linlin Ou , Tianxiao Chen , Xinyi Yu , Yifan Liu

Multi-modal foundation models such as CLIP have showcased impressive zero-shot capabilities. However, their applicability in resource-constrained environments is limited due to their large number of parameters and high inference time. While…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Niclas Popp , Jan Hendrik Metzen , Matthias Hein

Large-scale vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization, but adapting them to downstream tasks typically requires costly labeled data. Existing unsupervised self-training methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Qian-Wei Wang , Guanghao Meng , Ren Cai , Yaguang Song , Shu-Tao Xia

Household environments are visually diverse. Embodied agents performing Vision-and-Language Navigation (VLN) in the wild must be able to handle this diversity, while also following arbitrary language instructions. Recently, Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Vishnu Sashank Dorbala , Gunnar Sigurdsson , Robinson Piramuthu , Jesse Thomason , Gaurav S. Sukhatme

Large pretrained vision-language models like CLIP have shown promising generalization capability, but may struggle in specialized domains (e.g., satellite imagery) or fine-grained classification (e.g., car models) where the visual concepts…

Machine Learning · Computer Science 2024-11-01 Chen Huang , Skyler Seto , Samira Abnar , David Grangier , Navdeep Jaitly , Josh Susskind