English
Related papers

Related papers: Exploring Efficient Few-shot Adaptation for Vision…

200 papers

Few-shot learning (FSL), which aims to recognise new classes by adapting the learned knowledge with extremely limited few-shot (support) examples, remains an important open problem in computer vision. Most of the existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Chengming Xu , Chen Liu , Li Zhang , Chengjie Wang , Jilin Li , Feiyue Huang , Xiangyang Xue , Yanwei Fu

An old-school recipe for training a classifier is to (i) learn a good feature extractor and (ii) optimize a linear layer atop. When only a handful of samples are available per category, as in Few-Shot Adaptation (FSA), data are insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Matteo Farina , Massimiliano Mancini , Giovanni Iacca , Elisa Ricci

Cross-domain few-shot learning (CDFSL) aims to transfer knowledge from a data-sufficient source domain to data-scarce target domains. Although Vision Transformer (ViT) has shown superior capability in many vision tasks, its transferability…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Few-shot learning (FSL) aims to recognize novel queries with only a few support samples through leveraging prior knowledge from a base dataset. In this paper, we consider the domain shift problem in FSL and aim to address the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wentao Chen , Zhang Zhang , Wei Wang , Liang Wang , Zilei Wang , Tieniu Tan

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieve state-of-the-art performance. However, the performance of existing approaches heavily depends on the inter-class variance of the support…

Computation and Language · Computer Science 2023-06-12 Shuo Lei , Xuchao Zhang , Jianfeng He , Fanglan Chen , Chang-Tien Lu

The field of Few-Shot Learning (FSL), or learning from very few (typically $1$ or $5$) examples per novel class (unseen during training), has received a lot of attention and significant performance advances in the recent literature. While…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshe Lichtenstein , Prasanna Sattigeri , Rogerio Feris , Raja Giryes , Leonid Karlinsky

Prompt tuning, which involves training a small set of parameters, effectively enhances the pre-trained Vision-Language Models (VLMs) to downstream tasks. However, they often come at the cost of flexibility and adaptability when the tuned…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mushui Liu , Bozheng Li , Yunlong Yu

Few-shot recognition (FSR) aims to train a classification model with only a few labeled examples of each concept concerned by a downstream task, where data annotation cost can be prohibitively high. We develop methods to solve FSR by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tian Liu , Huixin Zhang , Shubham Parashar , Shu Kong

The remarkable representational power of Vision Transformers (ViTs) remains underutilized in few-shot image classification. In this work, we introduce ViT-ProtoNet, which integrates a ViT-Small backbone into the Prototypical Network…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Abdulvahap Mutlu , Şengül Doğan , Türker Tuncer

The recent popularity of foundation models and the pre-train-and-adapt paradigm, where a large-scale model is transferred to downstream tasks, is gaining attention for volumetric medical image segmentation. However, current transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Julio Silva-Rodríguez , Jose Dolz , Ismail Ben Ayed

Learning subtle representation about object parts plays a vital role in fine-grained visual recognition (FGVR) field. The vision transformer (ViT) achieves promising results on computer vision due to its attention mechanism. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yuan Zhang , Jian Cao , Ling Zhang , Xiangcheng Liu , Zhiyi Wang , Feng Ling , Weiqian Chen

The few-shot learning ability of vision transformers (ViTs) is rarely investigated though heavily desired. In this work, we empirically find that with the same few-shot learning frameworks, \eg~Meta-Baseline, replacing the widely used CNN…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

There has been a remarkable progress in learning a model which could recognise novel classes with only a few labeled examples in the last few years. Few-shot learning (FSL) for action recognition is a challenging task of recognising novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Neeraj Kumar , Siddhansh Narang

In this paper, we look at the problem of cross-domain few-shot classification that aims to learn a classifier from previously unseen classes and domains with few labeled samples. Recent approaches broadly solve this problem by…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Few-Shot Learning (FSL) is a challenging task, which aims to recognize novel classes with few examples. Recently, lots of methods have been proposed from the perspective of meta-learning and representation learning. However, few works focus…

Machine Learning · Computer Science 2023-07-27 Baoquan Zhang , Hao Jiang , Xutao Li , Shanshan Feng , Yunming Ye , Rui Ye

Few-shot learning (FSL) aims to learn models that generalize to novel classes with limited training samples. Recent works advance FSL towards a scenario where unlabeled examples are also available and propose semi-supervised FSL methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Linglan Zhao , Dashan Guo , Yunlu Xu , Liang Qiao , Zhanzhan Cheng , Shiliang Pu , Yi Niu , Xiangzhong Fang

Few-shot semantic segmentation (FSS) has achieved great success on segmenting objects of novel classes, supported by only a few annotated samples. However, existing FSS methods often underperform in the presence of domain shifts, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jiapeng Su , Qi Fan , Guangming Lu , Fanglin Chen , Wenjie Pei

Fine-tuning large pre-trained language models on various downstream tasks with whole parameters is prohibitively expensive. Hence, Parameter-efficient fine-tuning has attracted attention that only optimizes a few task-specific parameters…

Computation and Language · Computer Science 2023-05-25 Zhen-Ru Zhang , Chuanqi Tan , Haiyang Xu , Chengyu Wang , Jun Huang , Songfang Huang

Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer…

Machine Learning · Computer Science 2022-08-22 Yujin Kim , Jaehoon Oh , Sungnyun Kim , Se-Young Yun