English
Related papers

Related papers: Few-shot Sequence Learning with Transformers

200 papers

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Few-shot learning addresses the challenge of learning how to address novel tasks given not just limited supervision but limited data as well. An attractive solution is synthetic data generation. However, most such methods are overly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Michalis Lazarou , Tania Stathaki , Yannis Avrithis

Single image-level annotations only correctly describe an often small subset of an image's content, particularly when complex real-world scenes are depicted. While this might be acceptable in many classification scenarios, it poses a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Markus Hiller , Rongkai Ma , Mehrtash Harandi , Tom Drummond

Few-shot object detection is a challenging but realistic scenario, where only a few annotated training images are available for training detectors. A popular approach to handle this problem is transfer learning, i.e., fine-tuning a detector…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Ze Yang , Yali Wang , Xianyu Chen , Jianzhuang Liu , Yu Qiao

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

In-context learning, which offers substantial advantages over fine-tuning, is predominantly observed in decoder-only models, while encoder-decoder (i.e., seq2seq) models excel in methods that rely on weight updates. Recently, a few studies…

Computation and Language · Computer Science 2024-08-28 Jihyeon Lee , Dain Kim , Doohae Jung , Boseop Kim , Kyoung-Woon On

We show that the way inference is performed in few-shot segmentation tasks has a substantial effect on performances -- an aspect often overlooked in the literature in favor of the meta-learning paradigm. We introduce a transductive…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Malik Boudiaf , Hoel Kervadec , Ziko Imtiaz Masud , Pablo Piantanida , Ismail Ben Ayed , Jose Dolz

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduction in few-shot…

Machine Learning · Computer Science 2020-06-23 Carlos Medina , Arnout Devos , Matthias Grossglauser

Transfer learning has been widely adopted for few-shot classification. Recent studies reveal that obtaining good generalization representation of images on novel classes is the key to improving the few-shot classification accuracy. To…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Sai Yang , Fan Liu , Delong Chen , Jun Zhou

When training data is scarce, it is common to make use of a feature extractor that has been pre-trained on a large base dataset, either by fine-tuning its parameters on the ``target'' dataset or by directly adopting its representation as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Raphael Lafargue , Yassir Bendou , Bastien Pasdeloup , Jean-Philippe Diguet , Ian Reid , Vincent Gripon , Jack Valmadre

Few-shot learning deals with the fundamental and challenging problem of learning from a few annotated samples, while being able to generalize well on new tasks. The crux of few-shot learning is to extract prior knowledge from related tasks…

Machine Learning · Computer Science 2021-05-11 Yingjun Du , Haoliang Sun , Xiantong Zhen , Jun Xu , Yilong Yin , Ling Shao , Cees G. M. Snoek

Reinforcement learning and planning methods require an objective or reward function that encodes the desired behavior. Yet, in practice, there is a wide range of scenarios where an objective is difficult to provide programmatically, such as…

Machine Learning · Computer Science 2018-10-02 Annie Xie , Avi Singh , Sergey Levine , Chelsea Finn

Few-shot Learning (FSL) aims to classify new concepts from a small number of examples. While there have been an increasing amount of work on few-shot object classification in the last few years, most current approaches are limited to images…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Mathieu Pagé Fortin , Brahim Chaib-draa

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

Few-shot learning aims to adapt knowledge learned from previous tasks to novel tasks with only a limited amount of labeled data. Research literature on few-shot learning exhibits great diversity, while different algorithms often excel at…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Chi Zhang , Henghui Ding , Guosheng Lin , Ruibo Li , Changhu Wang , Chunhua Shen

In this paper, we look at the problem of cross-domain few-shot classification that aims to learn a classifier from previously unseen classes and domains with few labeled samples. Recent approaches broadly solve this problem by…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

This paper tackles the problem of few-shot learning, which aims to learn new visual concepts from a few examples. A common problem setting in few-shot classification assumes random sampling strategy in acquiring data labels, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Shipeng Yan , Songyang Zhang , Xuming He

Transfer-learning and meta-learning are two effective methods to apply knowledge learned from large data sources to new tasks. In few-class, few-shot target task settings (i.e. when there are only a few classes and training examples…

Machine Learning · Computer Science 2019-02-11 Amir Erfan Eshratifar , Mohammad Saeed Abrishami , David Eigen , Massoud Pedram

For specialized and dense downstream tasks such as object detection, labeling data requires expertise and can be very expensive, making few-shot and semi-supervised models much more attractive alternatives. While in the few-shot setup we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Quentin Bouniot , Angélique Loesch , Romaric Audigier , Amaury Habrard