English
Related papers

Related papers: TADAM: Task dependent adaptive metric for improved…

200 papers

Fine-tuning a deep network trained with the standard cross-entropy loss is a strong baseline for few-shot learning. When fine-tuned transductively, this outperforms the current state-of-the-art on standard datasets such as Mini-ImageNet,…

Machine Learning · Computer Science 2020-10-23 Guneet S. Dhillon , Pratik Chaudhari , Avinash Ravichandran , Stefano Soatto

Large-scale pre-trained models have achieved remarkable success in language and image tasks, leading an increasing number of studies to explore the application of pre-trained image models, such as CLIP, in the domain of few-shot action…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Congqi Cao , Peiheng Han , Yueran zhang , Yating Yu , Qinyi Lv , Lingtong Min , Yanning zhang

Meta-learning (ML) has emerged as a promising direction in learning models under constrained resource settings like few-shot learning. The popular approaches for ML either learn a generalizable initial model or a generic parametric…

Machine Learning · Computer Science 2022-03-07 Aroof Aimen , Sahil Sidheekh , Narayanan C. Krishnan

We introduce a simple non-linear embedding adaptation layer, which is fine-tuned on top of fixed pre-trained features for one-shot tasks, improving significantly transductive entropy-based inference for low-shot regimes. Our norm-induced…

Machine Learning · Computer Science 2023-04-17 Imtiaz Masud Ziko , Freddy Lecue , Ismail Ben Ayed

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

In the few-shot scenario, a learner must effectively generalize to unseen classes given a small support set of labeled examples. While a relatively large amount of research has gone into few-shot learning for image classification, little…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Chris Careaga , Brian Hutchinson , Nathan Hodas , Lawrence Phillips

Current few-shot learning models capture visual object relations in the so-called meta-learning setting under a fixed-resolution input. However, such models have a limited generalization ability under the scale and location mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongguang Zhang , Philip H. S. Torr , Piotr Koniusz

Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples. In this paper,…

Machine Learning · Computer Science 2023-06-02 Xu Luo , Hao Wu , Ji Zhang , Lianli Gao , Jing Xu , Jingkuan Song

Many few-shot learning approaches have been designed under the meta-learning framework, which learns from a variety of learning tasks and generalizes to new tasks. These meta-learning approaches achieve the expected performance in the…

Machine Learning · Computer Science 2022-01-05 Yongchun Zhu , Fuzhen Zhuang , Xiangliang Zhang , Zhiyuan Qi , Zhiping Shi , Juan Cao , Qing He

We consider a new problem of few-shot learning of compact models. Meta-learning is a popular approach for few-shot learning. Previous work in meta-learning typically assumes that the model architecture during meta-training is the same as…

Machine Learning · Computer Science 2022-10-19 Yong Wu , Shekhor Chanda , Mehrdad Hosseinzadeh , Zhi Liu , Yang Wang

Few-shot learning with $N$-way $K$-shot scheme is an open challenge in machine learning. Many metric-based approaches have been proposed to tackle this problem, e.g., the Matching Networks and CLIP-Adapter. Despite that these approaches…

Machine Learning · Computer Science 2024-05-08 Guoliang Lin , Yongheng Xu , Hanjiang Lai , Jian Yin

Learning and generalizing from limited examples, i,e, few-shot learning, is of core importance to many real-world vision applications. A principal way of achieving few-shot learning is to realize an embedding where samples from different…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Rongkai Ma , Pengfei Fang , Tom Drummond , Mehrtash Harandi

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieve state-of-the-art performance. However, the performance of existing approaches heavily depends on the inter-class variance of the support…

Computation and Language · Computer Science 2023-06-12 Shuo Lei , Xuchao Zhang , Jianfeng He , Fanglan Chen , Chang-Tien Lu

Few-shot learning (FSL) has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in learning to generalize from a few examples. This paper proposes an adaptive margin principle to improve…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Aoxue Li , Weiran Huang , Xu Lan , Jiashi Feng , Zhenguo Li , Liwei Wang

The performance of meta-learning approaches for few-shot learning generally depends on three aspects: features suitable for comparison, the classifier ( base learner ) suitable for low-data scenarios, and valuable information from the…

Machine Learning · Computer Science 2020-09-15 Haoqing Wang , Zhi-Hong Deng

Learning and generalizing to novel concepts with few samples (Few-Shot Learning) is still an essential challenge to real-world applications. A principle way of achieving few-shot learning is to realize a model that can rapidly adapt to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Rongkai Ma , Pengfei Fang , Gil Avraham , Yan Zuo , Tianyu Zhu , Tom Drummond , Mehrtash Harandi

A primary challenge faced in few-shot action recognition is inadequate video data for training. To address this issue, current methods in this field mainly focus on devising algorithms at the feature level while little attention is paid to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Huabin Liu , Weixian Lv , John See , Weiyao Lin

Single image-level annotations only correctly describe an often small subset of an image's content, particularly when complex real-world scenes are depicted. While this might be acceptable in many classification scenarios, it poses a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Markus Hiller , Rongkai Ma , Mehrtash Harandi , Tom Drummond

Handling previously unseen tasks after given only a few training examples continues to be a tough challenge in machine learning. We propose TapNets, neural networks augmented with task-adaptive projection for improved few-shot learning.…

Machine Learning · Computer Science 2019-06-24 Sung Whan Yoon , Jun Seo , Jaekyun Moon