English
Related papers

Related papers: Learning to Adapt CLIP for Few-Shot Monocular Dept…

200 papers

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

While Contrastive Language-Image Pretraining (CLIP) excels at zero-shot tasks by aligning image and text embeddings, its performance in few-shot classification is hindered by a critical limitation: intra-modal misalignment. This issue,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Christoph Timmermann , Hyunse Lee , Woojin Lee

Pre-trained vision-language (V-L) models such as CLIP have shown excellent generalization ability to downstream tasks. However, they are sensitive to the choice of input text prompts and require careful selection of prompt templates to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Muhammad Uzair Khattak , Hanoona Rasheed , Muhammad Maaz , Salman Khan , Fahad Shahbaz Khan

Vision-language models (VLMs) such as CLIP have shown promising performance on a variety of recognition tasks using the standard zero-shot classification procedure -- computing similarity between the query image and the embedded words for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Sachit Menon , Carl Vondrick

As a pioneering vision-language model, CLIP (Contrastive Language-Image Pre-training) has achieved significant success across various domains and a wide range of downstream vision-language tasks. However, the text encoders in popular CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Mothilal Asokan , Kebin Wu , Fatima Albreiki

Vision-language (V+L) pretraining models have achieved great success in supporting multimedia applications by understanding the alignments between images and text. While existing vision-language pretraining models primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Manling Li , Ruochen Xu , Shuohang Wang , Luowei Zhou , Xudong Lin , Chenguang Zhu , Michael Zeng , Heng Ji , Shih-Fu Chang

Vision-language models (VLMs), such as CLIP, have gained popularity for their strong open vocabulary classification performance, but they are prone to assigning high confidence scores to misclassifications, limiting their reliability in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zhenxiang Lin , Maryam Haghighat , Will Browne , Dimity Miller

Foundation vision-language models (VLMs) excel on natural images, but their utility for biomedical microscopy remains underexplored. In this paper, we investigate how in-context learning enables state-of-the-art VLMs to perform few-shot…

Recently, pre-trained vision-language models (e.g., CLIP) have shown great potential in few-shot learning and attracted a lot of research interest. Although efforts have been made to improve few-shot ability of CLIP, key factors on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yuwei Tang , Zhenyi Lin , Qilong Wang , Pengfei Zhu , Qinghua Hu

There are a thousand ways to caption an image. Contrastive Language Pretraining (CLIP) on the other hand, works by mapping an image and its caption to a single vector -- limiting how well CLIP-like models can represent the diverse ways to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Samuel Lavoie , Polina Kirichenko , Mark Ibrahim , Mahmoud Assran , Andrew Gordon Wilson , Aaron Courville , Nicolas Ballas

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

Vision-language models (VLMs) embed aligned image-text pairs into a joint space but often rely on deterministic embeddings, assuming a one-to-one correspondence between images and texts. This oversimplifies real-world relationships, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sanghyuk Chun , Wonjae Kim , Song Park , Sangdoo Yun

Multi-label classification is an essential task utilized in a wide variety of real-world applications. Multi-label zero-shot learning is a method for classifying images into multiple unseen categories for which no training data is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Muhammad Ali , Salman Khan

Recently, zero-shot and few-shot learning via Contrastive Vision-Language Pre-training (CLIP) have shown inspirational performance on 2D visual recognition, which learns to match images with their corresponding texts in open-vocabulary…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Renrui Zhang , Ziyu Guo , Wei Zhang , Kunchang Li , Xupeng Miao , Bin Cui , Yu Qiao , Peng Gao , Hongsheng Li

Image Anomaly Detection has been a challenging task in Computer Vision field. The advent of Vision-Language models, particularly the rise of CLIP-based frameworks, has opened new avenues for zero-shot anomaly detection. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhaoxiang Zhang , Hanqiu Deng , Jinan Bao , Xingyu Li

In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Qian Jin , Yuqi Jiang , Xudong Lu , Yumeng Liu , Yining Chen , Dawei Gao , Qi Sun , Cheng Zhuo

Depth information is the foundation of perception, essential for autonomous driving, robotics, and other source-constrained applications. Promptly obtaining accurate and efficient depth information allows for a rapid response in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Xin Zhang , Rabab Abdelfattah , Yuqi Song , Samuel A. Dauchert , Xiaofeng wang

Medical image classification plays a crucial role in clinical decision-making, yet most models are constrained to a fixed set of predefined classes, limiting their adaptability to new conditions. Contrastive Language-Image Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Stefan Denner , Markus Bujotzek , Dimitrios Bounias , David Zimmerer , Raphael Stock , Klaus Maier-Hein

Current self-supervised monocular depth estimation (MDE) approaches encounter performance limitations due to insufficient semantic-spatial knowledge extraction. To address this challenge, we propose Hybrid-depth, a novel framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Wenyao Zhang , Hongsi Liu , Bohan Li , Jiawei He , Zekun Qi , Yunnan Wang , Shengyang Zhao , Xinqiang Yu , Wenjun Zeng , Xin Jin