English
Related papers

Related papers: Few-shot Sequence Learning with Transformers

200 papers

Few-shot classification is the task of predicting the category of an example from a set of few labeled examples. The number of labeled examples per category is called the number of shots (or shot number). Recent works tackle this task…

Machine Learning · Computer Science 2022-06-22 Tianshi Cao , Marc Law , Sanja Fidler

The goal of this paper is to bypass the need for labelled examples in few-shot video understanding at run time. While proven effective, in many practical video settings even labelling a few examples appears unrealistic. This is especially…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Pengwan Yang , Yuki M. Asano , Pascal Mettes , Cees G. M. Snoek

The emergence of attention-based transformer models has led to their extensive use in various tasks, due to their superior generalization and transfer properties. Recent research has demonstrated that such models, when prompted…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

Few-shot learning allows pre-trained language models to adapt to downstream tasks while using a limited number of training examples. However, practical applications are limited when all model parameters must be optimized. In this work we…

Computation and Language · Computer Science 2023-02-01 Ethan Kim , Jerry Yang

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

To perform few-shot learning, language models extract signals from a few input-label pairs, aggregate these into a learned prediction rule, and apply this rule to new inputs. How is this implemented in the forward pass of modern transformer…

Machine Learning · Computer Science 2025-10-10 Xinyan Hu , Kayo Yin , Michael I. Jordan , Jacob Steinhardt , Lijie Chen

Recent papers have suggested that transfer learning can outperform sophisticated meta-learning methods for few-shot image classification. We take this hypothesis to its logical conclusion, and suggest the use of an ensemble of high-quality,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Arkabandhu Chowdhury , Mingchao Jiang , Swarat Chaudhuri , Chris Jermaine

Human beings can recognize new objects with only a few labeled examples, however, few-shot learning remains a challenging problem for machine learning systems. Most previous algorithms in few-shot learning only utilize spatial information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Xiangyu Chen , Guanghui Wang

Humans are able to learn to recognize new objects even from a few examples. In contrast, training deep-learning-based object detectors requires huge amounts of annotated data. To avoid the need to acquire and annotate these huge amounts of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Mona Köhler , Markus Eisenbach , Horst-Michael Gross

Few-shot learning aims to learn classifiers for new classes with only a few training examples per class. Most existing few-shot learning approaches belong to either metric-based meta-learning or optimization-based meta-learning category,…

Machine Learning · Computer Science 2019-08-28 Duo Wang , Yu Cheng , Mo Yu , Xiaoxiao Guo , Tao Zhang

Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Jun Seo , Young-Hyun Park , Sung Whan Yoon , Jaekyun Moon

Humans possess remarkable ability to accurately classify new, unseen images after being exposed to only a few examples. Such ability stems from their capacity to identify common features shared between new and previously seen images while…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Weihao Jiang , Chang Liu , Kun He

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

Time-series forecasting is important for many applications. Forecasting models are usually trained using time-series data in a specific target task. However, sufficient data in the target task might be unavailable, which leads to…

Machine Learning · Statistics 2020-10-01 Tomoharu Iwata , Atsutoshi Kumagai

Transformer-based language models have achieved remarkable success in few-shot in-context learning and drawn a lot of research interest. However, these models' performance greatly depends on the choice of the example prompts and also has…

Computation and Language · Computer Science 2023-06-21 Genta Indra Winata , Liang-Kang Huang , Soumya Vadlamannati , Yash Chandarana

Deep learning has shown great success in settings with massive amounts of data but has struggled when data is limited. Few-shot learning algorithms, which seek to address this limitation, are designed to generalize well to new tasks with…

With the continuous development of natural language processing (NLP) technology, text classification tasks have been widely used in multiple application fields. However, obtaining labeled data is often expensive and difficult, especially in…

Computation and Language · Computer Science 2025-02-14 Jia Gao , Shuangquan Lyu , Guiran Liu , Binrong Zhu , Hongye Zheng , Xiaoxuan Liao

Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Jun Seo , Young-Hyun Park , Sung-Whan Yoon , Jaekyun Moon

Learning high quality class representations from few examples is a key problem in metric-learning approaches to few-shot learning. To accomplish this, we introduce a novel architecture where class representations are conditioned for each…

Machine Learning · Computer Science 2018-02-14 Nathan Hilliard , Lawrence Phillips , Scott Howland , Artëm Yankov , Courtney D. Corley , Nathan O. Hodas

This paper addresses the few-shot image classification problem, where the classification task is performed on unlabeled query samples given a small amount of labeled support samples only. One major challenge of the few-shot learning problem…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Quang-Huy Nguyen , Cuong Q. Nguyen , Dung D. Le , Hieu H. Pham
‹ Prev 1 3 4 5 6 7 10 Next ›