English
Related papers

Related papers: How to Train Your MAML to Excel in Few-Shot Classi…

200 papers

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

When experience is scarce, models may have insufficient information to adapt to a new task. In this case, auxiliary information - such as a textual description of the task - can enable improved task inference and adaptation. In this work,…

Machine Learning · Computer Science 2022-10-11 Matthew T. Jackson , Shreshth A. Malik , Michael T. Matthews , Yousuf Mohamed-Ahmed

Model agnostic meta-learning algorithms aim to infer priors from several observed tasks that can then be used to adapt to a new task with few examples. Given the inherent diversity of tasks arising in existing benchmarks, recent methods use…

Machine Learning · Computer Science 2022-07-26 Rakshith Subramanyam , Mark Heimann , Jayram Thathachar , Rushil Anirudh , Jayaraman J. Thiagarajan

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

This paper considers meta-learning problems, where there is a distribution of tasks, and we would like to obtain an agent that performs well (i.e., learns quickly) when presented with a previously unseen task sampled from this distribution.…

Machine Learning · Computer Science 2018-10-23 Alex Nichol , Joshua Achiam , John Schulman

Recently, it has been observed that a transfer learning solution might be all we need to solve many few-shot learning benchmarks -- thus raising important questions about when and how meta-learning algorithms should be deployed. In this…

Machine Learning · Computer Science 2022-08-03 Brando Miranda , Patrick Yu , Yu-Xiong Wang , Sanmi Koyejo

Few-shot learning is a rapidly evolving area of research in machine learning where the goal is to classify unlabeled data with only one or "a few" labeled exemplary samples. Neural networks are typically trained to minimize a distance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Samuel Hess , Gregory Ditzler

Few-shot learning aims to recognize new categories using very few labeled samples. Although few-shot learning has witnessed promising development in recent years, most existing methods adopt an average operation to calculate prototypes,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Minglei Yuan , Wenhai Wang , Tao Wang , Chunhao Cai , Qian Xu , Tong Lu

Deep neural networks require large training sets but suffer from high computational cost and long training times. Training on much smaller training sets while maintaining nearly the same accuracy would be very beneficial. In the few-shot…

Machine Learning · Computer Science 2021-08-09 Ilia Sucholutsky , Matthias Schonlau

Many meta-learning methods are proposed for few-shot detection. However, previous most methods have two main problems, poor detection APs, and strong bias because of imbalance and insufficient datasets. Previous works mainly alleviate these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Qian Li , Nan Guo , Xiaochun Ye , Duo Wang , Dongrui Fan , Zhimin Tang

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modeling uncertainty,…

Machine Learning · Computer Science 2022-03-08 Lisha Chen , Tianyi Chen

Distance metric learning (DML) has been successfully applied to object classification, both in the standard regime of rich training data and in the few-shot scenario, where each category is represented by only a few examples. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Leonid Karlinsky , Joseph Shtok , Sivan Harary , Eli Schwartz , Amit Aides , Rogerio Feris , Raja Giryes , Alex M. Bronstein

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

Fine-tuning a deep network trained with the standard cross-entropy loss is a strong baseline for few-shot learning. When fine-tuned transductively, this outperforms the current state-of-the-art on standard datasets such as Mini-ImageNet,…

Machine Learning · Computer Science 2020-10-23 Guneet S. Dhillon , Pratik Chaudhari , Avinash Ravichandran , Stefano Soatto

Few-shot learning remains challenging for meta-learning that learns a learning algorithm (meta-learner) from many related tasks. In this work, we argue that this is due to the lack of a good representation for meta-learning, and propose…

Machine Learning · Computer Science 2018-02-13 Fengwei Zhou , Bin Wu , Zhenguo Li

Meta-learning allows an intelligent agent to leverage prior learning episodes as a basis for quickly improving performance on a novel task. Bayesian hierarchical modeling provides a theoretical framework for formalizing meta-learning as…

Machine Learning · Computer Science 2018-01-29 Erin Grant , Chelsea Finn , Sergey Levine , Trevor Darrell , Thomas Griffiths

Few-shot classification aims to carry out classification given only few labeled examples for the categories of interest. Though several approaches have been proposed, most existing few-shot learning (FSL) models assume that base and novel…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yuan-Chia Cheng , Ci-Siang Lin , Fu-En Yang , Yu-Chiang Frank Wang

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

Few-shot learning with $N$-way $K$-shot scheme is an open challenge in machine learning. Many metric-based approaches have been proposed to tackle this problem, e.g., the Matching Networks and CLIP-Adapter. Despite that these approaches…

Machine Learning · Computer Science 2024-05-08 Guoliang Lin , Yongheng Xu , Hanjiang Lai , Jian Yin

Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-learning algorithms, such as model-agnostic meta-learning…

Machine Learning · Statistics 2020-03-24 Diana Cai , Rishit Sheth , Lester Mackey , Nicolo Fusi