English
Related papers

Related papers: Evaluating the Evaluators: Are Current Few-Shot Le…

200 papers

Meta-learning methods have been extensively studied and applied in computer vision, especially for few-shot classification tasks. The key idea of meta-learning for few-shot classification is to mimic the few-shot situations faced at test…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Chenghao Liu , Zhihao Wang , Doyen Sahoo , Yuan Fang , Kun Zhang , Steven C. H. Hoi

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Few-shot learning with sequence-processing neural networks (NNs) has recently attracted a new wave of attention in the context of large language models. In the standard N-way K-shot learning setting, an NN is explicitly optimised to learn…

Machine Learning · Computer Science 2023-05-03 Kazuki Irie , Jürgen Schmidhuber

Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its…

Machine Learning · Computer Science 2024-03-07 Weihao Jiang , Guodong Liu , Di He , Kun He

Modern language models often exhibit powerful but brittle behavior, leading to the development of larger and more diverse benchmarks to reliably assess their behavior. Here, we suggest that model performance can be benchmarked and…

Computation and Language · Computer Science 2024-02-20 Rajan Vivek , Kawin Ethayarajh , Diyi Yang , Douwe Kiela

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

In machine learning, the selection of a promising model from a potentially large number of competing models and the assessment of its generalization performance are critical tasks that need careful consideration. Typically, model selection…

Machine Learning · Statistics 2023-02-06 Pascal Rink , Werner Brannath

Autonomous agents interacting with the real world need to learn new concepts efficiently and reliably. This requires learning in a low-data regime, which is a highly challenging problem. We address this task by introducing a fast…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ardhendu Shekhar Tripathi , Martin Danelljan , Luc Van Gool , Radu Timofte

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Meta-learning has emerged as a powerful training strategy for few-shot node classification, demonstrating its effectiveness in the transductive setting. However, the existing literature predominantly focuses on transductive few-shot node…

Machine Learning · Computer Science 2023-06-16 Hirthik Mathavan , Zhen Tan , Nivedh Mudiam , Huan Liu

Prompt-based approaches are strong at few-shot learning. However, Perez et al. (2021) have recently cast doubt on their performance because they had difficulty getting good results in a "true" few-shot setting in which prompts and…

Computation and Language · Computer Science 2021-11-29 Timo Schick , Hinrich Schütze

We propose regression networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each class. In high dimensional embedding…

Machine Learning · Computer Science 2020-06-22 Arnout Devos , Matthias Grossglauser

Classifying and analyzing human cells is a lengthy procedure, often involving a trained professional. In an attempt to expedite this process, an active area of research involves automating cell classification through use of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Reece Walsh , Mohamed H. Abdelpakey , Mohamed S. Shehata , Mostafa M. Mohamed

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Yan Wang , Wei-Lun Chao , Kilian Q. Weinberger , Laurens van der Maaten

Few-shot graph classification aims at predicting classes for graphs, given limited labeled graphs for each class. To tackle the bottleneck of label scarcity, recent works propose to incorporate few-shot learning frameworks for fast…

Machine Learning · Computer Science 2022-05-10 Song Wang , Yushun Dong , Xiao Huang , Chen Chen , Jundong Li

The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state-of-the-art pre-trained models typically need fine-tuning on…

Computation and Language · Computer Science 2021-10-13 Rakesh Chada , Pradeep Natarajan

Few-shot semantic segmentation models aim to segment images after learning from only a few annotated examples. A key challenge for them is how to avoid overfitting because limited training data is available. While prior works usually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

Models that top leaderboards often perform unsatisfactorily when deployed in real world applications; this has necessitated rigorous and expensive pre-deployment model testing. A hitherto unexplored facet of model performance is: Are our…

Computation and Language · Computer Science 2021-06-11 Swaroop Mishra , Anjana Arunkumar

Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the artificial ones within…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Jianyi Li , Guizhong Liu

In recent years, self-supervised learning has excelled for its capacity to learn robust feature representations from unlabelled data. Networks pretrained through self-supervision serve as effective feature extractors for downstream tasks,…

Sound · Computer Science 2024-02-15 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi