English
Related papers

Related papers: Transductive Zero-Shot and Few-Shot CLIP

200 papers

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

Recent advances in vision-language foundational models, such as CLIP, have demonstrated significant strides in zero-shot classification. However, the extensive parameterization of models like CLIP necessitates a resource-intensive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Qijie Wang , Guandu Liu , Bin Wang

Contrastive Language-Image Pretraining (CLIP) has demonstrated impressive zero-shot learning abilities for image understanding, yet limited effort has been made to investigate CLIP for zero-shot video recognition. We introduce Open-VCLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Zejia Weng , Xitong Yang , Ang Li , Zuxuan Wu , Yu-Gang Jiang

Inspired by the remarkable zero-shot generalization capacity of vision-language pre-trained model, we seek to leverage the supervision from CLIP model to alleviate the burden of data labeling. However, such supervision inevitably contains…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Junchu Huang , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

We address the problem of learning new classes for semantic segmentation models from few examples, which is challenging because of the following two reasons. Firstly, it is difficult to learn from limited novel data to capture the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Chengjia Jiang , Tao Wang , Sien Li , Jinyang Wang , Shirui Wang , Antonios Antoniou

Large vision-language models (VLMs) are shown to learn rich joint image-text representations enabling high performances in relevant downstream tasks. However, they fail to showcase their quantitative understanding of objects, and they lack…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Harshvardhan Mestha , Tejas Agrawal , Karan Bania , Shreyas V , Yash Bhisikar

In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Qian Jin , Yuqi Jiang , Xudong Lu , Yumeng Liu , Yining Chen , Dawei Gao , Qi Sun , Cheng Zhuo

Vision-language models (VLMs) like CLIP are trained with the objective of aligning text and image pairs. To improve CLIP-based few-shot image classification, recent works have observed that, along with text embeddings, image embeddings from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dipam Goswami , Simone Magistri , Gido M. van de Ven , Bartłomiej Twardowski , Andrew D. Bagdanov , Tinne Tuytelaars , Joost van de Weijer

This expository paper introduces a simplified approach to image-based quality inspection in manufacturing using OpenAI's CLIP (Contrastive Language-Image Pretraining) model adapted for few-shot learning. While CLIP has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Fadel M. Megahed , Ying-Ju Chen , Bianca Maria Colosimo , Marco Luigi Giuseppe Grasso , L. Allison Jones-Farmer , Sven Knoth , Hongyue Sun , Inez Zwetsloot

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduction in few-shot…

Machine Learning · Computer Science 2020-06-23 Carlos Medina , Arnout Devos , Matthias Grossglauser

A common problem with most zero and few-shot learning approaches is they suffer from bias towards seen classes resulting in sub-optimal performance. Existing efforts aim to utilize unlabeled images from unseen classes (i.e transductive…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Gaurav Bhatt , Shivam Chandhok , Vineeth N Balasubramanian

Recently, zero-shot multi-label classification has garnered considerable attention for its capacity to operate predictions on unseen labels without human annotations. Nevertheless, prevailing approaches often use seen classes as imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kaixin Zhang , Zhixiang Yuan , Tao Huang

In this work, we address the task of few-shot part segmentation, which aims to segment the different parts of an unseen object using very few labeled examples. It is found that leveraging the textual space of a powerful pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Mengya Han , Heliang Zheng , Chaoyue Wang , Yong Luo , Han Hu , Jing Zhang , Yonggang Wen

Few-shot classification requires adapting knowledge learned from a large annotated base dataset to recognize novel unseen classes, each represented by few labeled examples. In such a scenario, pretraining a network with high capacity on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Yiren Jian , Lorenzo Torresani

Long-tailed multi-label visual recognition poses a significant challenge, as images typically contain multiple labels with highly imbalanced class distributions, leading to biased models that favor head classes while underperforming on tail…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Wei Tang , Zuo-Zheng Wang , Kun Zhang , Tong Wei , Min-Ling Zhang

State-of-the-art empirical work has shown that visual representations learned by deep neural networks are robust in nature and capable of performing classification tasks on diverse datasets. For example, CLIP demonstrated zero-shot transfer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Chanda Grover , Indra Deep Mastan , Debayan Gupta

Few-shot Test-Time Domain Adaptation focuses on adapting a model at test time to a specific domain using only a few unlabeled examples, addressing domain shift. Prior methods leverage CLIP's strong out-of-distribution (OOD) abilities by…

Machine Learning · Computer Science 2025-06-24 Zhixiang Chi , Li Gu , Huan Liu , Ziqiang Wang , Yanan Wu , Yang Wang , Konstantinos N Plataniotis

Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. Zero-shot learning…

Machine Learning · Computer Science 2019-04-09 Meng Ye , Yuhong Guo

Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples. In this paper,…

Machine Learning · Computer Science 2023-06-02 Xu Luo , Hao Wu , Ji Zhang , Lianli Gao , Jing Xu , Jingkuan Song