English
Related papers

Related papers: CLIP's Visual Embedding Projector is a Few-shot Co…

200 papers

Recent adaptations can boost the low-shot capability of Contrastive Vision-Language Pre-training (CLIP) by effectively facilitating knowledge transfer. However, these adaptation methods are usually operated on the global view of an input…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinda Lu , Shuo Wang , Yanbin Hao , Haifeng Liu , Xiang Wang , Meng Wang

Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Muhammad Waleed Gondal , Jochen Gast , Inigo Alonso Ruiz , Richard Droste , Tommaso Macri , Suren Kumar , Luitpold Staudigl

Generalized Few-Shot Semantic Segmentation (GFSS) aims to extend a segmentation model to novel classes with only a few annotated examples while maintaining performance on base classes. Recently, pretrained vision-language models (VLMs) such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jie Liu , Jiayi Shen , Pan Zhou , Jan-Jakob Sonke , Efstratios Gavves

Zero-shot vision-language models (VLMs) have shown promise for chest radiograph classification, but their performance is often limited by confounding label co-occurrence, long-tail class imbalance, and transfer instability under domain…

Machine Learning · Computer Science 2026-04-21 Florian Kittler , Sheethal Bhat , Andreas Maier

Despite the recent success of image-text contrastive models like CLIP and SigLIP, these models often struggle with vision-centric tasks that demand high-fidelity image understanding, such as counting, depth estimation, and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zineng Tang , Long Lian , Seun Eisape , XuDong Wang , Roei Herzig , Adam Yala , Alane Suhr , Trevor Darrell , David M. Chan

We present RECLIP (Resource-efficient CLIP), a simple method that minimizes computational resource footprint for CLIP (Contrastive Language Image Pretraining). Inspired by the notion of coarse-to-fine in computer vision, we leverage small…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Runze Li , Dahun Kim , Bir Bhanu , Weicheng Kuo

Large-scale vision-language models such as CLIP achieve strong zero-shot recognition but struggle with classes that are rarely seen during pretraining, including newly emerging entities and culturally specific categories. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Aishwarya Agarwal , Srikrishna Karanam , Vineet Gandhi

An innovative few-shot anomaly detection approach is presented, leveraging the pre-trained CLIP model for medical data, and adapting it for both image-level anomaly classification (AC) and pixel-level anomaly segmentation (AS). A…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mahshid Shiri , Cigdem Beyan , Vittorio Murino

Vision-Language Models (VLMs) such as CLIP have shown remarkable performance in cross-modal tasks through large-scale contrastive pre-training. To adapt these large transformer-based models efficiently for downstream tasks,…

Machine Learning · Computer Science 2025-09-29 Sajjad Ghiasvand , Haniyeh Ehsani Oskouie , Mahnoosh Alizadeh , Ramtin Pedarsani

Recent advances in zero-shot and few-shot classification heavily rely on the success of pre-trained vision-language models (VLMs) such as CLIP. Due to a shortage of large-scale datasets, training such models for event camera data remains…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ziyi Wu , Xudong Liu , Igor Gilitschenski

The recent CLIP-based methods have shown promising zero-shot and few-shot performance on image classification tasks. Existing approaches such as CoOp and Tip-Adapter only focus on high-level visual features that are fully aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiaying Shi , Xuetong Xue , Shenghui Xu

Vision-language models (VLMs) like CLIP are trained with the objective of aligning text and image pairs. To improve CLIP-based few-shot image classification, recent works have observed that, along with text embeddings, image embeddings from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dipam Goswami , Simone Magistri , Gido M. van de Ven , Bartłomiej Twardowski , Andrew D. Bagdanov , Tinne Tuytelaars , Joost van de Weijer

Contrastive vision-language models excel in zero-shot image recognition but face challenges in few-shot scenarios due to computationally intensive offline fine-tuning using prompt learning, which risks overfitting. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Phuoc-Nguyen Bui , Khanh-Binh Nguyen , Hyunseung Choo

Vision-Language Pre-Trained models, notably CLIP, that utilize contrastive learning have proven highly adept at extracting generalizable visual features. To inherit the well-learned knowledge of VLP models for downstream tasks, several…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yi Zhang , Weicheng Lin , Liang-Jie Zhang

Although massive pre-trained vision-language models like CLIP show impressive generalization capabilities for many tasks, still it often remains necessary to fine-tune them for improved performance on specific datasets. When doing so, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Moritz Ibing , Isaak Lim , Leif Kobbelt

Adopting contrastive image-text pretrained models like CLIP towards video classification has gained attention due to its cost-effectiveness and competitive performance. However, recent works in this area face a trade-off. Finetuning the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Syed Talal Wasim , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

In the field of medical decision-making, precise anomaly detection in medical imaging plays a pivotal role in aiding clinicians. However, previous work is reliant on large-scale datasets for training anomaly detection models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ximiao Zhang , Min Xu , Dehui Qiu , Ruixin Yan , Ning Lang , Xiuzhuang Zhou

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

Visual anomaly classification and segmentation are vital for automating industrial quality inspection. The focus of prior research in the field has been on training custom models for each quality inspection task, which requires…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jongheon Jeong , Yang Zou , Taewan Kim , Dongqing Zhang , Avinash Ravichandran , Onkar Dabeer

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui