English
Related papers

Related papers: Probing Pre-trained Auto-regressive Language Model…

200 papers

Cross-domain NER is a practical yet challenging problem since the data scarcity in the real-world scenario. A common practice is first to learn a NER model in a rich-resource general domain and then adapt the model to specific domains. Due…

Computation and Language · Computer Science 2024-08-09 Junhao Zheng , Haibin Chen , Qianli Ma

Recent breakthroughs of pretrained language models have shown the effectiveness of self-supervised learning for a wide range of natural language processing (NLP) tasks. In addition to standard syntactic and semantic NLP tasks, pretrained…

Computation and Language · Computer Science 2019-12-23 Wenhan Xiong , Jingfei Du , William Yang Wang , Veselin Stoyanov

Named Entity Recognition (NER) is a crucial upstream task in Natural Language Processing (NLP). Traditional tag scheme approaches offer a single recognition that does not meet the needs of many downstream tasks such as coreference…

Computation and Language · Computer Science 2020-04-30 Wendong He , Yizhen Shao , Pingjian Zhang

Recently, prompt-based methods have achieved significant performance in few-shot learning scenarios by bridging the gap between language model pre-training and fine-tuning for downstream tasks. However, existing prompt templates are mostly…

Computation and Language · Computer Science 2022-03-09 Liwen Wang , Rumei Li , Yang Yan , Yuanmeng Yan , Sirui Wang , Wei Wu , Weiran Xu

Recurrent Neural Network models are the state-of-the-art for Named Entity Recognition (NER). We present two innovations to improve the performance of these models. The first innovation is the introduction of residual connections between the…

Computation and Language · Computer Science 2017-07-12 Quan Tran , Andrew MacKinlay , Antonio Jimeno Yepes

In nested Named entity recognition (NER), entities are nested with each other, and thus requiring more data annotations to address. This leads to the development of few-shot nested NER, where the prevalence of pretrained language models…

Computation and Language · Computer Science 2024-02-05 Meishan Zhang , Bin Wang , Hao Fei , Min Zhang

Named entity recognition (NER) is usually developed and tested on text from well-written sources. However, in intelligent voice assistants, where NER is an important component, input to NER may be noisy because of user or speech recognition…

Recent advancements in language models (LMs) have led to the emergence of powerful models such as Small LMs (e.g., T5) and Large LMs (e.g., GPT-4). These models have demonstrated exceptional capabilities across a wide range of tasks, such…

Computation and Language · Computer Science 2024-05-07 Mingchen Li , Rui Zhang

Named entity recognition (NER) is a well-studied task in natural language processing. Traditional NER research only deals with flat entities and ignores nested entities. The span-based methods treat entity recognition as a span…

Computation and Language · Computer Science 2021-07-14 Yongliang Shen , Xinyin Ma , Zeqi Tan , Shuai Zhang , Wen Wang , Weiming Lu

Few-shot named entity recognition (NER) systems aims at recognizing new classes of entities based on a few labeled samples. A significant challenge in the few-shot regime is prone to overfitting than the tasks with abundant samples. The…

Computation and Language · Computer Science 2023-05-04 Zhen Yang , Yongbin Liu , Chunping Ouyang

Lately, instruction-based techniques have made significant strides in improving performance in few-shot learning scenarios. They achieve this by bridging the gap between pre-trained language models and fine-tuning for specific downstream…

Information Retrieval · Computer Science 2024-01-25 Hiranmai Sri Adibhatla , Pavan Baswani , Manish Shrivastava

Named entity recognition (NER) is the task to detect and classify the entity spans in the text. When entity spans overlap between each other, this problem is named as nested NER. Span-based methods have been widely used to tackle the nested…

Computation and Language · Computer Science 2022-09-16 Hang Yan , Yu Sun , Xiaonan Li , Xipeng Qiu

Named Entity Recognition (NER) aims at locating and classifying named entities in text. In some use cases of NER, including cases where detected named entities are used in creating content recommendations, it is crucial to have a reliable…

Neural and Evolutionary Computing · Computer Science 2017-12-07 Mahdi Namazifar

Named-entity recognition (NER) is a task that typically requires large annotated datasets, which limits its applicability across domains with varying entity definitions. This paper addresses few-shot NER, aiming to transfer knowledge to new…

Computation and Language · Computer Science 2024-12-13 Ayoub Hammal , Benno Uthayasooriyar , Caio Corro

Named entity recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying entities in sentences into pre-defined types. It plays a crucial role in various research fields, including entity…

Computation and Language · Computer Science 2024-04-29 Dongsheng Wang , Xiaoqin Feng , Zeming Liu , Chuan Wang

The use of BERT, one of the most popular language models, has led to improvements in many Natural Language Processing (NLP) tasks. One such task is Named Entity Recognition (NER) i.e. automatic identification of named entities such as…

Computation and Language · Computer Science 2023-03-10 Harshil Darji , Jelena Mitrović , Michael Granitzer

Named Entity Recognition (NER) is a well researched NLP task and is widely used in real world NLP scenarios. NER research typically focuses on the creation of new ways of training NER, with relatively less emphasis on resources and…

Computation and Language · Computer Science 2022-05-05 Sowmya Vajjala , Ramya Balasubramaniam

India's rich cultural and linguistic diversity poses various challenges in the domain of Natural Language Processing (NLP), particularly in Named Entity Recognition (NER). NER is a NLP task that aims to identify and classify tokens into…

Computation and Language · Computer Science 2025-02-07 Mohammed Amaan Dhamaskar , Rasika Ransing

Nested named entity recognition identifies entities contained within other entities, but requires expensive multi-level annotation. While flat NER corpora exist abundantly, nested resources remain scarce. We investigate whether models can…

Computation and Language · Computer Science 2026-03-03 Igor Rozhkov , Natalia Loukachevitch

Named-entity recognition (NER) in low-resource languages is usually tackled by finetuning very large multilingual LMs, an option that is often infeasible in memory- or latency-constrained settings. We ask whether small decoder LMs can be…

Computation and Language · Computer Science 2025-10-07 David Demitri Africa , Suchir Salhan , Yuval Weiss , Paula Buttery , Richard Diehl Martinez