中文
相关论文

相关论文: The Devil is in the Few Shots: Iterative Visual Kn…

200 篇论文

State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM)…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Sivan Doveh , Shaked Perek , M. Jehanzeb Mirza , Wei Lin , Amit Alfassy , Assaf Arbelle , Shimon Ullman , Leonid Karlinsky

In the realm of few-shot learning, foundation models like CLIP have proven effective but exhibit limitations in cross-domain robustness especially in few-shot settings. Recent works add text as an extra modality to enhance the performance…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Yassir Bendou , Vincent Gripon , Bastien Pasdeloup , Giulia Lioi , Lukas Mauch , Fabien Cardinaux , Ghouthi Boukli Hacene

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Transductive few-shot learning has triggered an abundant literature focusing on vision-only models, but is still at a nascent stage within the recent context of foundational vision-language models (VLMs). Only a few recent methods addressed…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Ghassen Baklouti , Maxime Zanella , Ismail Ben Ayed

Prevailing deep graph learning models often suffer from label sparsity issue. Although many graph few-shot learning (GFL) methods have been developed to avoid performance degradation in face of limited annotated data, they excessively rely…

机器学习 · 计算机科学 2022-10-04 Chunhui Zhang , Hongfu Liu , Jundong Li , Yanfang Ye , Chuxu Zhang

Hierarchical text classification (HTC) is an important task with broad applications, while few-shot HTC has gained increasing interest recently. While in-context learning (ICL) with large language models (LLMs) has achieved significant…

计算与语言 · 计算机科学 2024-07-02 Huiyao Chen , Yu Zhao , Zulong Chen , Mengjia Wang , Liangyue Li , Meishan Zhang , Min Zhang

In the field of vision-language contrastive learning, models such as CLIP capitalize on matched image-caption pairs as positive examples and leverage within-batch non-matching pairs as negatives. This approach has led to remarkable outcomes…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Maxwell Aladago , Lorenzo Torresani , Soroush Vosoughi

We develop a transductive meta-learning method that uses unlabelled instances to improve few-shot image classification performance. Our approach combines a regularized Mahalanobis-distance-based soft k-means clustering procedure with a…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Peyman Bateni , Jarred Barber , Jan-Willem van de Meent , Frank Wood

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

计算机视觉与模式识别 · 计算机科学 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

计算机视觉与模式识别 · 计算机科学 2019-03-29 Debasmit Das , C. S. George Lee

Cross-Domain Few-Shot Learning (CDFSL) adapts models trained with large-scale general data (source domain) to downstream target domains with only scarce training data, where the research on vision-language models (e.g., CLIP) is still in…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yaze Zhao , Yixiong Zou , Yuhua Li , Ruixuan Li

Few-shot video action recognition is an effective approach to recognizing new categories with only a few labeled examples, thereby reducing the challenges associated with collecting and annotating large-scale video datasets. Existing…

计算机视觉与模式识别 · 计算机科学 2023-09-18 Sarinda Samarasinghe , Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Few-shot learning aims to learn to generalize a classifier to novel classes with limited labeled data. Transductive inference that utilizes unlabeled test set to deal with low-data problem has been employed for few-shot learning in recent…

计算机视觉与模式识别 · 计算机科学 2019-06-11 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Large-scale Pre-Training Vision-Language Model such as CLIP has demonstrated outstanding performance in zero-shot classification, e.g. achieving 76.3% top-1 accuracy on ImageNet without seeing any example, which leads to potential benefits…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Xuefeng Hu , Ke Zhang , Lu Xia , Albert Chen , Jiajia Luo , Yuyin Sun , Ken Wang , Nan Qiao , Xiao Zeng , Min Sun , Cheng-Hao Kuo , Ram Nevatia

With the emergence of Transformers and Vision-Language Models (VLMs) such as CLIP, fine-tuning large pre-trained models has recently become a prevalent strategy in Continual Learning. This has led to the development of numerous prompting…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Emanuele Frascaroli , Aniello Panariello , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Few-shot classification studies the problem of quickly adapting a deep learner to understanding novel classes based on few support images. In this context, recent research efforts have been aimed at designing more and more complex…

计算机视觉与模式识别 · 计算机科学 2022-02-21 Jun He , Richang Hong , Xueliang Liu , Mingliang Xu , Qianru Sun

A common problem with most zero and few-shot learning approaches is they suffer from bias towards seen classes resulting in sub-optimal performance. Existing efforts aim to utilize unlabeled images from unseen classes (i.e transductive…

计算机视觉与模式识别 · 计算机科学 2021-07-15 Gaurav Bhatt , Shivam Chandhok , Vineeth N Balasubramanian

Image captioning aims at generating descriptive and meaningful textual descriptions of images, enabling a broad range of vision-language applications. Prior works have demonstrated that harnessing the power of Contrastive Image Language…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Longtian Qiu , Shan Ning , Xuming He

Contrastive Language-Image Pretraining (CLIP) has been widely used in vision tasks. Notably, CLIP has demonstrated promising performance in few-shot learning (FSL). However, existing CLIP-based methods in training-free FSL (i.e., without…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Yayuan Li , Jintao Guo , Lei Qi , Wenbin Li , Yinghuan Shi

We consider the problem of zero-shot one-class visual classification, extending traditional one-class classification to scenarios where only the label of the target class is available. This method aims to discriminate between positive and…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Yassir Bendou , Giulia Lioi , Bastien Pasdeloup , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux , Vincent Gripon