English
Related papers

Related papers: Few-shot Sequence Learning with Transformers

200 papers

Episodic training is a mainstream training strategy for few-shot learning. In few-shot scenarios, however, this strategy is often inferior to some non-episodic training strategy, e. g., Neighbourhood Component Analysis (NCA), which…

Machine Learning · Computer Science 2024-02-02 Tao Zhang

Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This…

Machine Learning · Computer Science 2024-09-23 Xingtong Yu , Yuan Fang , Zemin Liu , Yuxia Wu , Zhihao Wen , Jianyuan Bo , Xinming Zhang , Steven C. H. Hoi

Scene graph prediction --- classifying the set of objects and predicates in a visual scene --- requires substantial training data. However, most predicates only occur a handful of times making them difficult to learn. We introduce the first…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Apoorva Dornadula , Austin Narcomey , Ranjay Krishna , Michael Bernstein , Li Fei-Fei

Few-shot Semantic Segmentation addresses the challenge of segmenting objects in query images with only a handful of annotated examples. However, many previous state-of-the-art methods either have to discard intricate local semantic features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Amirreza Fateh , Mohammad Reza Mohammadi , Mohammad Reza Jahed Motlagh

Most few-shot learning works rely on the same domain assumption between the base and the target tasks, hindering their practical applications. This paper proposes an adaptive transformer network (ADAPTER), a simple but effective solution…

Machine Learning · Computer Science 2024-01-26 Naeem Paeedeh , Mahardhika Pratama , Muhammad Anwar Ma'sum , Wolfgang Mayer , Zehong Cao , Ryszard Kowlczyk

The ability to quickly learn a new task with minimal instruction - known as few-shot learning - is a central aspect of intelligent agents. Classical few-shot benchmarks make use of few-shot samples from a single modality, but such samples…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhiqiu Lin , Samuel Yu , Zhiyi Kuang , Deepak Pathak , Deva Ramanan

We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks…

Machine Learning · Computer Science 2017-06-21 Jake Snell , Kevin Swersky , Richard S. Zemel

Topic models have been successfully used for analyzing text documents. However, with existing topic models, many documents are required for training. In this paper, we propose a neural network-based few-shot learning method that can learn a…

Computation and Language · Computer Science 2021-04-20 Tomoharu Iwata

Current event detection models under super-vised learning settings fail to transfer to newevent types. Few-shot learning has not beenexplored in event detection even though it al-lows a model to perform well with high gener-alization on new…

Computation and Language · Computer Science 2020-06-19 Viet Dac Lai , Franck Dernoncourt , Thien Huu Nguyen

An old-school recipe for training a classifier is to (i) learn a good feature extractor and (ii) optimize a linear layer atop. When only a handful of samples are available per category, as in Few-Shot Adaptation (FSA), data are insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Matteo Farina , Massimiliano Mancini , Giovanni Iacca , Elisa Ricci

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

Few-Shot Class-Incremental Learning presents an extension of the Class Incremental Learning problem where a model is faced with the problem of data scarcity while addressing the catastrophic forgetting problem. This problem remains an open…

Machine Learning · Computer Science 2024-05-13 Naeem Paeedeh , Mahardhika Pratama , Sunu Wibirama , Wolfgang Mayer , Zehong Cao , Ryszard Kowalczyk

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

Machine Learning · Computer Science 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero

Few-shot learning is a rapidly evolving area of research in machine learning where the goal is to classify unlabeled data with only one or "a few" labeled exemplary samples. Neural networks are typically trained to minimize a distance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Samuel Hess , Gregory Ditzler

Deep learning becomes an elevated context regarding disposing of many machine learning tasks and has shown a breakthrough upliftment to extract features from unstructured data. Though this flourishing context is developing in the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-06-01 Jannatul Nayem , Sayed Sahriar Hasan , Noshin Amina , Bristy Das , Md Shahin Ali , Md Manjurul Ahsan , Shivakumar Raman

Few-shot deep learning is a topical challenge area for scaling visual recognition to open ended growth of unseen new classes with limited labeled examples. A promising approach is based on metric learning, which trains a deep embedding to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Xueting Zhang , Yuting Qiang , Flood Sung , Yongxin Yang , Timothy M. Hospedales

Recent studies have shown remarkable success in image-to-image translation for attribute transfer applications. However, most of existing approaches are based on deep learning and require an abundant amount of labeled data to produce good…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Ricard Durall , Franz-Josef Pfreundt , Janis Keuper

Few-shot object detection aims to detect instances of specific categories in a query image with only a handful of support samples. Although this takes less effort than obtaining enough annotated images for supervised object detection, it…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Hojun Lee , Myunggi Lee , Nojun Kwak

Episodic training is a core ingredient of few-shot learning to train models on tasks with limited labelled data. Despite its success, episodic training remains largely understudied, prompting us to ask the question: what is the best way to…

Machine Learning · Computer Science 2022-01-19 Sébastien M. R. Arnold , Guneet S. Dhillon , Avinash Ravichandran , Stefano Soatto

Conventional methods for object detection usually require substantial amounts of training data and annotated bounding boxes. If there are only a few training data and annotations, the object detectors easily overfit and fail to generalize.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Geonuk Kim , Hong-Gyu Jung , Seong-Whan Lee