English
Related papers

Related papers: Rethinking Few Shot CLIP Benchmarks: A Critical An…

200 papers

This paper presents a CLIP-based unsupervised learning method for annotation-free multi-label image classification, including three stages: initialization, training, and inference. At the initialization stage, we take full advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Rabab Abdelfattah , Qing Guo , Xiaoguang Li , Xiaofeng Wang , Song Wang

Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including few-shot classification. Few-shot classification involves…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Victor Pellegrain , Malik Boudiaf , Victor Storchan , Myriam Tami , Ismail Ben Ayed , Celine Hudelot , Pablo Piantanida

Few-shot classification refers to learning a classifier for new classes given only a few examples. While a plethora of models have emerged to tackle it, we find the procedure and datasets that are used to assess their progress lacking. To…

Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks. These models leverage the synergy between visual and textual information, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Fangming Cui , Yonggang Zhang , Xuan Wang , Xule Wang , Liang Xiao

Recent advances in zero-shot and few-shot classification heavily rely on the success of pre-trained vision-language models (VLMs) such as CLIP. Due to a shortage of large-scale datasets, training such models for event camera data remains…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ziyi Wu , Xudong Liu , Igor Gilitschenski

Real-world classification tasks are frequently required to work in an open-set setting. This is especially challenging for few-shot learning problems due to the small sample size for each known category, which prevents existing open-set…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Jedrzej Kozerawski , Matthew Turk

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

Few-shot learning aims to learn to generalize a classifier to novel classes with limited labeled data. Transductive inference that utilizes unlabeled test set to deal with low-data problem has been employed for few-shot learning in recent…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

In the field of medical decision-making, precise anomaly detection in medical imaging plays a pivotal role in aiding clinicians. However, previous work is reliant on large-scale datasets for training anomaly detection models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ximiao Zhang , Min Xu , Dehui Qiu , Ruixin Yan , Ning Lang , Xiuzhuang Zhou

Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Jie-Jing Shao , Jiang-Xin Shi , Xiao-Wen Yang , Lan-Zhe Guo , Yu-Feng Li

Few-shot classification studies the problem of quickly adapting a deep learner to understanding novel classes based on few support images. In this context, recent research efforts have been aimed at designing more and more complex…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Jun He , Richang Hong , Xueliang Liu , Mingliang Xu , Qianru Sun

The Contrastive Language-Image Pre-training (CLIP) has recently shown remarkable generalization on "zero-shot" training and has applied to many downstream tasks. We explore the adaptation of CLIP to achieve a more efficient and generalized…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Qiang Wang , Junlong Du , Ke Yan , Shouhong Ding

Few-shot learning with $N$-way $K$-shot scheme is an open challenge in machine learning. Many metric-based approaches have been proposed to tackle this problem, e.g., the Matching Networks and CLIP-Adapter. Despite that these approaches…

Machine Learning · Computer Science 2024-05-08 Guoliang Lin , Yongheng Xu , Hanjiang Lai , Jian Yin

Recently, pre-trained vision-language models (e.g., CLIP) have shown great potential in few-shot learning and attracted a lot of research interest. Although efforts have been made to improve few-shot ability of CLIP, key factors on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yuwei Tang , Zhenyi Lin , Qilong Wang , Pengfei Zhu , Qinghua Hu

Pretrained vision-language models, such as CLIP, show promising zero-shot performance across a wide variety of datasets. For closed-set classification tasks, however, there is an inherent limitation: CLIP image encoders are typically…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Piyapat Saranrittichai , Mauricio Munoz , Volker Fischer , Chaithanya Kumar Mummadi

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Zejiang Hou , Sun-Yuan Kung

Industrial anomaly classification (AC) is an indispensable task in industrial manufacturing, which guarantees quality and safety of various product. To address the scarcity of data in industrial scenarios, lots of few-shot anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu

We introduce ProLIP, a simple and architecture-agnostic method for adapting contrastively pretrained vision-language models, such as CLIP, to few-shot classification. ProLIP fine-tunes the vision encoder's projection matrix with Frobenius…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mohammad Fahes , Tuan-Hung Vu , Andrei Bursuc , Patrick Pérez , Raoul de Charette

Multi-label classification is an essential task utilized in a wide variety of real-world applications. Multi-label zero-shot learning is a method for classifying images into multiple unseen categories for which no training data is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Muhammad Ali , Salman Khan

Large multi-modal models (LMMs) hold the potential to usher in a new era of automated visual assistance for people who are blind or low vision (BLV). Yet, these models have not been systematically evaluated on data captured by BLV users. We…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Daniela Massiceti , Camilla Longden , Agnieszka Słowik , Samuel Wills , Martin Grayson , Cecily Morrison