English
Related papers

Related papers: Good Examples Make A Faster Learner: Simple Demons…

200 papers

Few-shot named entity recognition (NER) detects named entities within text using only a few annotated examples. One promising line of research is to leverage natural language descriptions of each entity type: the common label PER might, for…

Computation and Language · Computer Science 2024-03-22 Jonas Golde , Felix Hamborg , Alan Akbik

In-context learning enables language models (LM) to adapt to downstream data or tasks by incorporating few samples as demonstrations within the prompts. It offers strong performance without the expense of fine-tuning. However, the…

Computation and Language · Computer Science 2024-10-15 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

Topic models have been successfully used for analyzing text documents. However, with existing topic models, many documents are required for training. In this paper, we propose a neural network-based few-shot learning method that can learn a…

Computation and Language · Computer Science 2021-04-20 Tomoharu Iwata

Few-shot named entity recognition (NER) aims to recognize novel named entities in low-resource domains utilizing existing knowledge. However, the present few-shot NER models assume that the labeled data are all clean without noise or…

Computation and Language · Computer Science 2023-12-14 Xiaojun Xue , Chunxia Zhang , Tianxiang Xu , Zhendong Niu

Recent advances on prompt-tuning cast few-shot classification tasks as a masked language modeling problem. By wrapping input into a template and using a verbalizer which constructs a mapping between label space and label word space,…

Computation and Language · Computer Science 2022-01-17 Yinyi Wei , Tong Mo , Yongtao Jiang , Weiping Li , Wen Zhao

Training neural models for named entity recognition (NER) in a new domain often requires additional human annotations (e.g., tens of thousands of labeled instances) that are usually expensive and time-consuming to collect. Thus, a crucial…

Computation and Language · Computer Science 2020-07-08 Bill Yuchen Lin , Dong-Ho Lee , Ming Shen , Ryan Moreno , Xiao Huang , Prashant Shiralkar , Xiang Ren

Named entity recognition (NER), which focuses on the extraction of semantically meaningful named entities and their semantic classes from text, serves as an indispensable component for several down-stream natural language processing (NLP)…

Computation and Language · Computer Science 2018-10-23 Zhanming Jie , Aldrian Obaja Muis , Wei Lu

Few-shot learning with sequence-processing neural networks (NNs) has recently attracted a new wave of attention in the context of large language models. In the standard N-way K-shot learning setting, an NN is explicitly optimised to learn…

Machine Learning · Computer Science 2023-05-03 Kazuki Irie , Jürgen Schmidhuber

Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel…

Computation and Language · Computer Science 2022-06-17 Ali Davody , David Ifeoluwa Adelani , Thomas Kleinbauer , Dietrich Klakow

Distantly-Supervised Named Entity Recognition (DS-NER) effectively alleviates the data scarcity problem in NER by automatically generating training samples. Unfortunately, the distant supervision may induce noisy labels, thus undermining…

Computation and Language · Computer Science 2022-12-14 Xiaoye Qu , Jun Zeng , Daizong Liu , Zhefeng Wang , Baoxing Huai , Pan Zhou

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Although deep learning techniques have shown significant achievements, they frequently depend on extensive amounts of hand-labeled data and tend to perform inadequately in few-shot scenarios. The objective of this study is to devise a…

Computation and Language · Computer Science 2024-10-28 Leilei Su , Jian Chen , Yifan Peng , Cong Sun

Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span-based methods, considering the entity recognition as a span…

Computation and Language · Computer Science 2021-06-22 Zeqi Tan , Yongliang Shen , Shuai Zhang , Weiming Lu , Yueting Zhuang

Some NLP tasks can be solved in a fully unsupervised fashion by providing a pretrained language model with "task descriptions" in natural language (e.g., Radford et al., 2019). While this approach underperforms its supervised counterpart,…

Computation and Language · Computer Science 2021-01-26 Timo Schick , Hinrich Schütze

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

Large language models (LLMs) benefit greatly from prompt engineering, with in-context learning standing as a pivital technique. While former approaches have provided various ways to construct the demonstrations used for in-context learning,…

Artificial Intelligence · Computer Science 2024-06-18 Yiming Tang , Bin Dong

The remarkable advancements in large language models (LLMs) have significantly enhanced the performance in few-shot learning settings. By using only a small number of labeled examples, referred to as demonstrations, LLMs can effectively…

Computation and Language · Computer Science 2023-11-23 Katerina Margatina , Timo Schick , Nikolaos Aletras , Jane Dwivedi-Yu

Pre-trained language models (PLMs) have exhibited remarkable few-shot learning capabilities when provided a few examples in a natural language prompt as demonstrations of test instances, i.e., in-context learning. However, the performance…

Computation and Language · Computer Science 2022-12-06 Feng Nie , Meixi Chen , Zhirui Zhang , Xu Cheng

Manually labeled corpora are expensive to create and often not available for low-resource languages or domains. Automatic labeling approaches are an alternative way to obtain labeled data in a quicker and cheaper way. However, these labels…

Machine Learning · Computer Science 2018-07-24 Michael A. Hedderich , Dietrich Klakow

Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the problem of few-shot NER by…

Computation and Language · Computer Science 2022-04-14 Tingting Ma , Huiqiang Jiang , Qianhui Wu , Tiejun Zhao , Chin-Yew Lin