English
Related papers

Related papers: CLIP's Visual Embedding Projector is a Few-shot Co…

200 papers

Self-supervised models trained with a contrastive loss such as CLIP have shown to be very powerful in zero-shot classification settings. However, to be used as a zero-shot classifier these models require the user to provide new captions…

Machine Learning · Computer Science 2022-10-31 Bhawesh Kumar , Anil Palepu , Rudraksh Tuwani , Andrew Beam

Large-scale pretrained vision-language models like CLIP have demonstrated remarkable zero-shot image classification capabilities across diverse domains. To enhance CLIP's performance while preserving the zero-shot paradigm, various…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Xuefeng Hu , Ke Zhang , Min Sun , Albert Chen , Cheng-Hao Kuo , Ram Nevatia

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

Large-scale foundation models, such as CLIP, have demonstrated impressive zero-shot generalization performance on downstream tasks, leveraging well-designed language prompts. However, these prompt learning techniques often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shirsha Bose , Ankit Jha , Enrico Fini , Mainak Singha , Elisa Ricci , Biplab Banerjee

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

Contrastive Language-Image Pre-training (CLIP) has become the standard for cross-modal image-text representation learning. Improving CLIP typically requires additional data and retraining with new loss functions, but these demands raise…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Haonan Wang , Minbin Huang , Runhui Huang , Lanqing Hong , Hang Xu , Tianyang Hu , Xiaodan Liang , Zhenguo Li , Hong Cheng , Kenji Kawaguchi

Vision-language models, such as CLIP, have achieved significant success in aligning visual and textual representations, becoming essential components of many multi-modal large language models (MLLMs) like LLaVA and OpenFlamingo. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shizhan Gong , Yankai Jiang , Qi Dou , Farzan Farnia

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Efficiently adapting large Vision-Language Models (VLMs) like CLIP for few-shot learning poses challenges in balancing pre-trained knowledge retention and task-specific adaptation. Existing methods often overlook valuable structural…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dazhi Huang

Few-shot adaptation of vision-language models (VLMs) like CLIP typically relies on learning textual prompts matched to global image embeddings. Recent works extend this paradigm by incorporating local image-text alignment to capture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Deniz Kizaroğlu , Ülku Tuncer Küçüktas , Emre Çakmakyurdu , Alptekin Temizel

Prompt tuning, which involves training a small set of parameters, effectively enhances the pre-trained Vision-Language Models (VLMs) to downstream tasks. However, they often come at the cost of flexibility and adaptability when the tuned…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mushui Liu , Bozheng Li , Yunlong Yu

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Medical image classification plays a crucial role in clinical decision-making, yet most models are constrained to a fixed set of predefined classes, limiting their adaptability to new conditions. Contrastive Language-Image Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Stefan Denner , Markus Bujotzek , Dimitrios Bounias , David Zimmerer , Raphael Stock , Klaus Maier-Hein

Large multi-modal models (LMMs) hold the potential to usher in a new era of automated visual assistance for people who are blind or low vision (BLV). Yet, these models have not been systematically evaluated on data captured by BLV users. We…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Daniela Massiceti , Camilla Longden , Agnieszka Słowik , Samuel Wills , Martin Grayson , Cecily Morrison

We propose Context-Adaptive Multi-Prompt Embedding, a novel approach to enrich semantic representations in vision-language contrastive learning. Unlike standard CLIP-style models that rely on a single text embedding, our method introduces…

Machine Learning · Computer Science 2025-08-07 Dahun Kim , Anelia Angelova

While the Contrastive Language-Image Pretraining(CLIP) model has achieved remarkable success in a variety of downstream vison language understanding tasks, enhancing its capability for fine-grained image-text alignment remains an active…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yicheng Xiao , Yu Chen , Haoxuan Ma , Jiale Hong , Caorui Li , Lingxiang Wu , Haiyun Guo , Jinqiao Wang

Multimodal pre-trained models, such as CLIP, are popular for zero-shot classification due to their open-vocabulary flexibility and high performance. However, vision-language models, which compute similarity scores between images and class…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mia Chiquier , Utkarsh Mall , Carl Vondrick

Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on existing evaluations of overall classification robustness, this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Weijie Tu , Weijian Deng , Tom Gedeon

Image enhancement is a significant research area in the fields of computer vision and image processing. In recent years, many learning-based methods for image enhancement have been developed, where the Look-up-table (LUT) has proven to be…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Weiwen Chen , Qiuhong Ke , Zinuo Li

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unprecedented human-like…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Bang An , Sicheng Zhu , Michael-Andrei Panaitescu-Liess , Chaithanya Kumar Mummadi , Furong Huang