English
Related papers

Related papers: Human in the loop: How to effectively create coher…

200 papers

Language models exhibit an emergent ability to learn a new task from a small number of input-output demonstrations. However, recent work shows that in-context learners largely rely on their pre-trained knowledge, such as the sentiment of…

Computation and Language · Computer Science 2023-07-20 Michal Štefánik , Marek Kadlčík

Few-shot learning with large-scale, pre-trained language models is a powerful way to answer questions about code, e.g., how to complete a given code example, or even generate code snippets from scratch. The success of these models raises…

Software Engineering · Computer Science 2022-06-14 Patrick Bareiß , Beatriz Souza , Marcelo d'Amorim , Michael Pradel

Text classification is the task of assigning a document to a predefined class. However, it is expensive to acquire enough labeled documents or to label them. In this paper, we study the regularization methods' effects on various…

Computation and Language · Computer Science 2024-03-05 Jongga Lee , Jaeseung Yim , Seohee Park , Changwon Lim

In many practical few-shot learning problems, even though labeled examples are scarce, there are abundant auxiliary datasets that potentially contain useful information. We propose the problem of extended few-shot learning to study these…

Machine Learning · Computer Science 2021-07-06 Reza Esfandiarpoor , Amy Pu , Mohsen Hajabdollahi , Stephen H. Bach

Language segmentation consists in finding the boundaries where one language ends and another language begins in a text written in more than one language. This is important for all natural language processing tasks. The problem can be solved…

Computation and Language · Computer Science 2015-10-07 David Alfter

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Few-shot classification is the task of predicting the category of an example from a set of few labeled examples. The number of labeled examples per category is called the number of shots (or shot number). Recent works tackle this task…

Machine Learning · Computer Science 2022-06-22 Tianshi Cao , Marc Law , Sanja Fidler

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base, which is significant and fundamental for various downstream applications, e.g., knowledge base completion, question answering, and…

Computation and Language · Computer Science 2022-07-20 Xiuxing Li , Zhenyu Li , Zhengyan Zhang , Ning Liu , Haitao Yuan , Wei Zhang , Zhiyuan Liu , Jianyong Wang

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples in support images. Most of advanced solutions exploit a metric learning framework that performs segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Jiacheng Chen , Bin-Bin Gao , Zongqing Lu , Jing-Hao Xue , Chengjie Wang , Qingmin Liao

The field of visual few-shot classification aims at transferring the state-of-the-art performance of deep learning visual systems onto tasks where only a very limited number of training samples are available. The main solution consists in…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yassir Bendou , Lucas Drumetz , Vincent Gripon , Giulia Lioi , Bastien Pasdeloup

In this paper, we propose a novel approach for few-shot semantic segmentation with sparse labeled images. We investigate the effectiveness of our method, which is based on the Model-Agnostic Meta-Learning (MAML) algorithm, in the medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Pedro H. T. Gama , Hugo Oliveira , Jefersson A. dos Santos

The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new…

Computation and Language · Computer Science 2020-10-13 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

In recent years, self-supervised learning has excelled for its capacity to learn robust feature representations from unlabelled data. Networks pretrained through self-supervision serve as effective feature extractors for downstream tasks,…

Sound · Computer Science 2024-02-15 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

Computation and Language · Computer Science 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

We consider the problem of semi-supervised few-shot classification where a classifier needs to adapt to new tasks using a few labeled examples and (potentially many) unlabeled examples. We propose a clustering approach to the problem. The…

Machine Learning · Computer Science 2018-04-26 Rinu Boney , Alexander Ilin

In this paper, we explore meta-learning for few-shot text classification. Meta-learning has shown strong performance in computer vision, where low-level patterns are transferable across learning tasks. However, directly applying this…

Computation and Language · Computer Science 2020-02-19 Yujia Bao , Menghua Wu , Shiyu Chang , Regina Barzilay

Current methods for few-shot fine-tuning of pretrained masked language models (PLMs) require carefully engineered prompts and verbalizers for each new task to convert examples into a cloze-format that the PLM can score. In this work, we…

Computation and Language · Computer Science 2022-04-27 Rabeeh Karimi Mahabadi , Luke Zettlemoyer , James Henderson , Marzieh Saeidi , Lambert Mathias , Veselin Stoyanov , Majid Yazdani

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

Machine Learning · Computer Science 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou