English
Related papers

Related papers: Few-shot learning for sentence pair classification…

200 papers

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Early detection of power outages is crucial for maintaining a reliable power distribution system. This research investigates the use of transfer learning and language models in detecting outages with limited labeled data. By leveraging…

Computation and Language · Computer Science 2023-05-30 Olukunle Owolabi

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Language models built using semi-supervised machine learning on large corpora of natural language have very quickly enveloped the fields of natural language generation and understanding. In this paper we apply a zero-shot approach…

Computation and Language · Computer Science 2022-01-25 Darren Abramson , Ali Emami

Scaling language models have revolutionized widespread NLP tasks, yet little comprehensively explored few-shot relation extraction with large language models. In this paper, we investigate principal methodologies, in-context learning and…

Computation and Language · Computer Science 2023-06-12 Xin Xu , Yuqi Zhu , Xiaohan Wang , Ningyu Zhang

Few-Shot Learning is the challenge of training a model with only a small amount of data. Many solutions to this problem use meta-learning algorithms, i.e. algorithms that learn to learn. By sampling few-shot tasks from a larger dataset, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Etienne Bennequin

Even though large pre-trained multilingual models (e.g. mBERT, XLM-R) have led to significant performance gains on a wide range of cross-lingual NLP tasks, success on many downstream tasks still relies on the availability of sufficient…

Computation and Language · Computer Science 2021-09-07 M Saiful Bari , Batool Haider , Saab Mansour

Few-shot learning (FSL) aims to generate a classifier using limited labeled examples. Many existing works take the meta-learning approach, constructing a few-shot learner that can learn from few-shot examples to generate a classifier.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Han-Jia Ye , Lu Ming , De-Chuan Zhan , Wei-Lun Chao

Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However,…

Computation and Language · Computer Science 2024-08-19 Martin Juan José Bucher , Marco Martini

Large pre-trained language models have shown promise for few-shot learning, completing text-based tasks given only a few task-specific examples. Will models soon solve classification tasks that have so far been reserved for human research…

The field of machine learning has recently made significant progress in reducing the requirements for labelled training data when building new models. These `cheaper' learning techniques hold significant potential for the social sciences,…

Computation and Language · Computer Science 2025-07-29 Leonardo Castro-Gonzalez , Yi-Ling Chung , Hannak Rose Kirk , John Francis , Angus R. Williams , Pica Johansson , Jonathan Bright

Despite the huge and continuous advances in computational linguistics, the lack of annotated data for Named Entity Recognition (NER) is still a challenging issue, especially in low-resource languages and when domain knowledge is required…

Computation and Language · Computer Science 2021-11-25 Valerio La Gatta , Vincenzo Moscato , Marco Postiglione , Giancarlo Sperlì

Data augmentation techniques are widely used for enhancing the performance of machine learning models by tackling class imbalance issues and data sparsity. State-of-the-art generative language models have been shown to provide significant…

Computation and Language · Computer Science 2023-01-10 Aleksandra Edwards , Asahi Ushio , Jose Camacho-Collados , Hélène de Ribaupierre , Alun Preece

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

Few-shot learning (FSL) has attracted considerable attention recently. Among existing approaches, the metric-based method aims to train an embedding network that can make similar samples close while dissimilar samples as far as possible and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

Few-shot classification (FSC) is a fundamental yet challenging task in computer vision that involves recognizing novel classes from limited data. While previous methods have focused on enhancing visual features or incorporating additional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Fan Liu , Wenwen Cai , Jian Huo , Chuanyi Zhang , Delong Chen , Jun Zhou

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

Traditional recognition methods typically require large, artificially-balanced training classes, while few-shot learning methods are tested on artificially small ones. In contrast to both extremes, real world recognition problems exhibit…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Davis Wertheimer , Bharath Hariharan

Few-shot learning and self-supervised learning address different facets of the same problem: how to train a model with little or no labeled data. Few-shot learning aims for optimization methods and models that can learn efficiently to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Spyros Gidaris , Andrei Bursuc , Nikos Komodakis , Patrick Pérez , Matthieu Cord

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

Machine Learning · Computer Science 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun