English
Related papers

Related papers: Task-Adapter: Task-specific Adaptation of Image Mo…

200 papers

Adaptive sampling that exploits the spatiotemporal redundancy in videos is critical for always-on action recognition on wearable devices with limited computing and battery resources. The commonly used fixed sampling strategy is not…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Khoi-Nguyen C. Mac , Minh N. Do , Minh P. Vo

Few-shot action recognition (FSAR) aims to learn a model capable of identifying novel actions in videos using only a few examples. In assuming the base dataset seen during meta-training and novel dataset used for evaluation can come from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Georgia Markham , Mehala Balamurali , Andrew J. Hill

Despite excellent progress has been made, the performance of deep learning based algorithms still heavily rely on specific datasets, which are difficult to extend due to labor-intensive labeling. Moreover, because of the advancement of new…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zhen Wei , Bingkun Liu , Weinong Wang , Yu-Wing Tai

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

Machine Learning · Computer Science 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations using large-scale image-text pairs. It shows impressive performance on downstream tasks by zero-shot knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Renrui Zhang , Zhang Wei , Rongyao Fang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

We investigate cross-domain few-shot learning under the constraint that fine-tuning of backbones (i.e., feature extractors) is impossible or infeasible -- a scenario that is increasingly common in practical use cases. Handling the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xin Xu , Eibe Frank , Geoffrey Holmes

Few-shot object detection, learning to adapt to the novel classes with a few labeled data, is an imperative and long-lasting problem due to the inherent long-tail distribution of real-world data and the urgent demands to cut costs of data…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Leng Jiaxu , Chen Taiyue , Gao Xinbo , Yu Yongtao , Wang Ye , Gao Feng , Wang Yue

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Recent work on action recognition leverages 3D features and textual information to achieve state-of-the-art performance. However, most of the current few-shot action recognition methods still rely on 2D frame-level representations, often…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Yutao Tang , Benjamin Bejar , Rene Vidal

Gradient-based meta-learning techniques aim to distill useful prior knowledge from a set of training tasks such that new tasks can be learned more efficiently with gradient descent. While these methods have achieved successes in various…

Machine Learning · Computer Science 2023-10-16 Mike Huisman , Aske Plaat , Jan N. van Rijn

Few-Shot classification aims at solving problems that only a few samples are available in the training process. Due to the lack of samples, researchers generally employ a set of training tasks from other domains to assist the target task,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Renjie Xu , Xinghao Yang , Baodi Liu , Kai Zhang , Weifeng Liu

In recent years, video action recognition, as a fundamental task in the field of video understanding, has been deeply explored by numerous researchers.Most traditional video action recognition methods typically involve converting videos…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junlin Chen , Chengcheng Xu , Yangfan Xu , Jian Yang , Jun Li , Zhiping Shi

Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kun Song , Huimin Ma , Bochao Zou , Huishuai Zhang , Weiran Huang

An old-school recipe for training a classifier is to (i) learn a good feature extractor and (ii) optimize a linear layer atop. When only a handful of samples are available per category, as in Few-Shot Adaptation (FSA), data are insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Matteo Farina , Massimiliano Mancini , Giovanni Iacca , Elisa Ricci

Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common in practice.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Hongyang Li , David Eigen , Samuel Dodge , Matthew Zeiler , Xiaogang Wang

Overfitting is a significant challenge in Few-Shot Learning (FSL), where models trained on small, variable datasets tend to memorize rather than generalize to unseen tasks. Regularization is crucial in FSL to prevent overfitting and enhance…

Machine Learning · Computer Science 2025-02-28 Mohammad Rostami , Atik Faysal , Huaxia Wang , Avimanyu Sahoo

Finetuning a pretrained model has become a standard approach for training neural networks on novel tasks, resulting in fast convergence and improved performance. In this work, we study an alternative finetuning method, where instead of…

Machine Learning · Computer Science 2023-07-04 Gal Kaplun , Andrey Gurevich , Tal Swisa , Mazor David , Shai Shalev-Shwartz , Eran Malach

We study the question: How can we select the right data for fine-tuning to a specific task? We call this data selection problem active fine-tuning and show that it is an instance of transductive active learning, a novel generalization of…

Machine Learning · Computer Science 2024-06-24 Jonas Hübotter , Bhavya Sukhija , Lenart Treven , Yarden As , Andreas Krause

Prompt tuning has been an extremely effective tool to adapt a pre-trained model to downstream tasks. However, standard prompt-based methods mainly consider the case of sufficient data of downstream tasks. It is still unclear whether the…

Computation and Language · Computer Science 2022-07-19 Ping Yu , Wei Wang , Chunyuan Li , Ruiyi Zhang , Zhanpeng Jin , Changyou Chen

Few-shot semantic segmentation models aim to segment images after learning from only a few annotated examples. A key challenge for them is how to avoid overfitting because limited training data is available. While prior works usually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari