English
Related papers

Related papers: SpanProto: A Two-stage Span-based Prototypical Net…

200 papers

Fine-tuning pre-trained language models has recently become a common practice in building NLP models for various tasks, especially few-shot tasks. We argue that under the few-shot setting, formulating fine-tuning closer to the pre-training…

Computation and Language · Computer Science 2022-11-01 Zihan Wang , Kewen Zhao , Zilong Wang , Jingbo Shang

Few-shot named entity recognition (NER) detects named entities within text using only a few annotated examples. One promising line of research is to leverage natural language descriptions of each entity type: the common label PER might, for…

Computation and Language · Computer Science 2024-03-22 Jonas Golde , Felix Hamborg , Alan Akbik

We present a simple few-shot named entity recognition (NER) system based on nearest neighbor learning and structured inference. Our system uses a supervised NER model trained on the source domain, as a feature extractor. Across several test…

Computation and Language · Computer Science 2020-10-07 Yi Yang , Arzoo Katiyar

Recently, prompt-based methods have achieved significant performance in few-shot learning scenarios by bridging the gap between language model pre-training and fine-tuning for downstream tasks. However, existing prompt templates are mostly…

Computation and Language · Computer Science 2022-03-09 Liwen Wang , Rumei Li , Yang Yan , Yuanmeng Yan , Sirui Wang , Wei Wu , Weiran Xu

Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Current few-shot NER methods focus on leveraging existing datasets in the rich-resource domains which might fail in a…

Computation and Language · Computer Science 2022-10-14 Zeng Yang , Linhai Zhang , Deyu Zhou

Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Most existing prototype-based sequence labeling models tend to memorize entity mentions which would be easily confused by close…

Computation and Language · Computer Science 2023-04-13 Guanting Dong , Zechen Wang , Liwen Wang , Daichi Guo , Dayuan Fu , Yuxiang Wu , Chen Zeng , Xuefeng Li , Tingfeng Hui , Keqing He , Xinyue Cui , Qixiang Gao , Weiran Xu

For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle Named Entity…

Computation and Language · Computer Science 2018-12-18 Alexander Fritzler , Varvara Logacheva , Maksim Kretov

Few-shot NER aims to identify entities of target types with only limited number of illustrative instances. Unfortunately, few-shot NER is severely challenged by the intrinsic precise generalization problem, i.e., it is hard to accurately…

Computation and Language · Computer Science 2024-03-26 Jiawei Chen , Hongyu Lin , Xianpei Han , Yaojie Lu , Shanshan Jiang , Bin Dong , Le Sun

Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel…

Computation and Language · Computer Science 2022-06-17 Ali Davody , David Ifeoluwa Adelani , Thomas Kleinbauer , Dietrich Klakow

Recently, prompt-based learning for pre-trained language models has succeeded in few-shot Named Entity Recognition (NER) by exploiting prompts as task guidance to increase label efficiency. However, previous prompt-based methods for…

Computation and Language · Computer Science 2022-03-07 Andy T. Liu , Wei Xiao , Henghui Zhu , Dejiao Zhang , Shang-Wen Li , Andrew Arnold

Named Entity Recognition (NER) is a key component in industrial information extraction pipelines, where systems must satisfy strict latency and throughput constraints in addition to strong accuracy. State-of-the-art NER accuracy is often…

Computation and Language · Computer Science 2026-04-23 Andrea Maracani , Savas Ozkan , Junyi Zhu , Sinan Mutlu , Mete Ozay

Few-shot learning has been used to tackle the problem of label scarcity in text classification, of which meta-learning based methods have shown to be effective, such as the prototypical networks (PROTO). Despite the success of PROTO, there…

Computation and Language · Computer Science 2023-03-17 Chengcheng Han , Yuhe Wang , Yingnan Fu , Xiang Li , Minghui Qiu , Ming Gao , Aoying Zhou

Supervised named entity recognition (NER) in the biomedical domain depends on large sets of annotated texts with the given named entities. The creation of such datasets can be time-consuming and expensive, while extraction of new entities…

Computation and Language · Computer Science 2024-08-27 Miloš Košprdić , Nikola Prodanović , Adela Ljajić , Bojana Bašaragin , Nikola Milošević

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

Meta-learning methods have been widely used in few-shot named entity recognition (NER), especially prototype-based methods. However, the Other(O) class is difficult to be represented by a prototype vector because there are generally a large…

Computation and Language · Computer Science 2023-02-16 Chengcheng Han , Renyu Zhu , Jun Kuang , FengJiao Chen , Xiang Li , Ming Gao , Xuezhi Cao , Wei Wu

We study the problem of few-shot Fine-grained Entity Typing (FET), where only a few annotated entity mentions with contexts are given for each entity type. Recently, prompt-based tuning has demonstrated superior performance to standard…

Computation and Language · Computer Science 2022-06-29 Jiaxin Huang , Yu Meng , Jiawei Han

In a surprising turn, Large Language Models (LLMs) together with a growing arsenal of prompt-based heuristics now offer powerful off-the-shelf approaches providing few-shot solutions to myriad classic NLP problems. However, despite…

Computation and Language · Computer Science 2023-06-21 Dhananjay Ashok , Zachary C. Lipton

StackOverflow, with its vast question repository and limited labeled examples, raise an annotation challenge for us. We address this gap by proposing RoBERTa+MAML, a few-shot named entity recognition (NER) method leveraging meta-learning.…

Computation and Language · Computer Science 2024-04-30 Xinwei Chen , Kun Li , Tianyou Song , Jiangjian Guo

This study proposes a medical entity extraction method based on Transformer to enhance the information extraction capability of medical literature. Considering the professionalism and complexity of medical texts, we compare the performance…

Computation and Language · Computer Science 2025-04-08 Xiaokai Wang , Guiran Liu , Binrong Zhu , Jacky He , Hongye Zheng , Hanlu Zhang

Named entity recognition (NER) is the task to detect and classify the entity spans in the text. When entity spans overlap between each other, this problem is named as nested NER. Span-based methods have been widely used to tackle the nested…

Computation and Language · Computer Science 2022-09-16 Hang Yan , Yu Sun , Xiaonan Li , Xipeng Qiu