English
Related papers

Related papers: The Devil is in the Few Shots: Iterative Visual Kn…

200 papers

State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Sivan Doveh , Shaked Perek , M. Jehanzeb Mirza , Wei Lin , Amit Alfassy , Assaf Arbelle , Shimon Ullman , Leonid Karlinsky

In the realm of few-shot learning, foundation models like CLIP have proven effective but exhibit limitations in cross-domain robustness especially in few-shot settings. Recent works add text as an extra modality to enhance the performance…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yassir Bendou , Vincent Gripon , Bastien Pasdeloup , Giulia Lioi , Lukas Mauch , Fabien Cardinaux , Ghouthi Boukli Hacene

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Transductive few-shot learning has triggered an abundant literature focusing on vision-only models, but is still at a nascent stage within the recent context of foundational vision-language models (VLMs). Only a few recent methods addressed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ghassen Baklouti , Maxime Zanella , Ismail Ben Ayed

Prevailing deep graph learning models often suffer from label sparsity issue. Although many graph few-shot learning (GFL) methods have been developed to avoid performance degradation in face of limited annotated data, they excessively rely…

Machine Learning · Computer Science 2022-10-04 Chunhui Zhang , Hongfu Liu , Jundong Li , Yanfang Ye , Chuxu Zhang

Hierarchical text classification (HTC) is an important task with broad applications, while few-shot HTC has gained increasing interest recently. While in-context learning (ICL) with large language models (LLMs) has achieved significant…

Computation and Language · Computer Science 2024-07-02 Huiyao Chen , Yu Zhao , Zulong Chen , Mengjia Wang , Liangyue Li , Meishan Zhang , Min Zhang

In the field of vision-language contrastive learning, models such as CLIP capitalize on matched image-caption pairs as positive examples and leverage within-batch non-matching pairs as negatives. This approach has led to remarkable outcomes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Maxwell Aladago , Lorenzo Torresani , Soroush Vosoughi

We develop a transductive meta-learning method that uses unlabelled instances to improve few-shot image classification performance. Our approach combines a regularized Mahalanobis-distance-based soft k-means clustering procedure with a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Peyman Bateni , Jarred Barber , Jan-Willem van de Meent , Frank Wood

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Debasmit Das , C. S. George Lee

Cross-Domain Few-Shot Learning (CDFSL) adapts models trained with large-scale general data (source domain) to downstream target domains with only scarce training data, where the research on vision-language models (e.g., CLIP) is still in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yaze Zhao , Yixiong Zou , Yuhua Li , Ruixuan Li

Few-shot video action recognition is an effective approach to recognizing new categories with only a few labeled examples, thereby reducing the challenges associated with collecting and annotating large-scale video datasets. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Sarinda Samarasinghe , Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Few-shot learning aims to learn to generalize a classifier to novel classes with limited labeled data. Transductive inference that utilizes unlabeled test set to deal with low-data problem has been employed for few-shot learning in recent…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Large-scale Pre-Training Vision-Language Model such as CLIP has demonstrated outstanding performance in zero-shot classification, e.g. achieving 76.3% top-1 accuracy on ImageNet without seeing any example, which leads to potential benefits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xuefeng Hu , Ke Zhang , Lu Xia , Albert Chen , Jiajia Luo , Yuyin Sun , Ken Wang , Nan Qiao , Xiao Zeng , Min Sun , Cheng-Hao Kuo , Ram Nevatia

With the emergence of Transformers and Vision-Language Models (VLMs) such as CLIP, fine-tuning large pre-trained models has recently become a prevalent strategy in Continual Learning. This has led to the development of numerous prompting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Emanuele Frascaroli , Aniello Panariello , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Few-shot classification studies the problem of quickly adapting a deep learner to understanding novel classes based on few support images. In this context, recent research efforts have been aimed at designing more and more complex…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Jun He , Richang Hong , Xueliang Liu , Mingliang Xu , Qianru Sun

A common problem with most zero and few-shot learning approaches is they suffer from bias towards seen classes resulting in sub-optimal performance. Existing efforts aim to utilize unlabeled images from unseen classes (i.e transductive…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Gaurav Bhatt , Shivam Chandhok , Vineeth N Balasubramanian

Image captioning aims at generating descriptive and meaningful textual descriptions of images, enabling a broad range of vision-language applications. Prior works have demonstrated that harnessing the power of Contrastive Image Language…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Longtian Qiu , Shan Ning , Xuming He

Contrastive Language-Image Pretraining (CLIP) has been widely used in vision tasks. Notably, CLIP has demonstrated promising performance in few-shot learning (FSL). However, existing CLIP-based methods in training-free FSL (i.e., without…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yayuan Li , Jintao Guo , Lei Qi , Wenbin Li , Yinghuan Shi

We consider the problem of zero-shot one-class visual classification, extending traditional one-class classification to scenarios where only the label of the target class is available. This method aims to discriminate between positive and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yassir Bendou , Giulia Lioi , Bastien Pasdeloup , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux , Vincent Gripon