English
Related papers

Related papers: Few-shot Learning for Named Entity Recognition in …

200 papers

We propose a combined three pre-trained language models (XLM-R, BART, and DeBERTa-V3) as an empower of contextualized embedding for named entity recognition. Our model achieves a 92.9% F1 score on the test set and ranks 5th on the…

Computation and Language · Computer Science 2022-12-15 Xuan-Dung Doan

Numbers are essential components of text, like any other word tokens, from which natural language processing (NLP) models are built and deployed. Though numbers are typically not accounted for distinctly in most NLP tasks, there is still an…

Computation and Language · Computer Science 2022-09-20 Dhanasekar Sundararaman , Vivek Subramanian , Guoyin Wang , Liyan Xu , Lawrence Carin

Here we present the training and evaluation of NanoNER, a Named Entity Recognition (NER) model for Nanobiology. NER consists in the identification of specific entities in spans of unstructured texts and is often a primary task in Natural…

Information Retrieval · Computer Science 2024-02-07 Martin Lentschat , Cyril Labbé , Ran Cheng

Named Entity Recognition (NER) is a fundamental task in NLP that is used to locate the key information in text and is primarily applied in conversational and search systems. In commercial applications, NER or comparable slot-filling methods…

Computation and Language · Computer Science 2023-06-13 Maithili Sabane , Aparna Ranade , Onkar Litake , Parth Patil , Raviraj Joshi , Dipali Kadam

We study clinical Named Entity Recognition (NER) on the CADEC corpus and compare three families of approaches: (i) BERT-style encoders (BERT Base, BioClinicalBERT, RoBERTa-large), (ii) GPT-4o used with few-shot in-context learning (ICL)…

Computation and Language · Computer Science 2025-10-28 Andrei Baroian

Fine-Grained Named Entity Recognition (FG-NER) is critical for many NLP applications. While classical named entity recognition (NER) has attracted a substantial amount of research, FG-NER is still an open research domain. The current…

Computation and Language · Computer Science 2019-02-27 Thai-Hoang Pham , Khai Mai , Nguyen Minh Trung , Nguyen Tuan Duc , Danushka Bolegala , Ryohei Sasano , Satoshi Sekine

Objective: We investigate whether deep learning techniques for natural language processing (NLP) can be used efficiently for patient phenotyping. Patient phenotyping is a classification task for determining whether a patient has a medical…

Clinical studies often require understanding elements of a patient's narrative that exist only in free text clinical notes. To transform notes into structured data for downstream use, these elements are commonly extracted and normalized to…

Computation and Language · Computer Science 2020-08-03 Monica Agrawal , Chloe O'Connell , Yasmin Fatemi , Ariel Levy , David Sontag

Large language models (LLMs) have become the preferred solution for many natural language processing tasks. In low-resource environments such as specialized domains, their few-shot capabilities are expected to deliver high performance.…

Computation and Language · Computer Science 2024-10-10 Marco Naguib , Xavier Tannier , Aurélie Névéol

In recent years, Deep Learning (DL) models are becoming important due to their demonstrated success at overcoming complex learning problems. DL models have been applied effectively for different Natural Language Processing (NLP) tasks such…

Computation and Language · Computer Science 2019-11-06 Hamada A. Nayel , Shashrekha H. L

Named Entity Recognition (NER) models play a crucial role in various NLP tasks, including information extraction (IE) and text understanding. In academic writing, references to machine learning models and datasets are fundamental components…

Computation and Language · Computer Science 2023-11-17 Wolfgang Otto , Matthäus Zloch , Lu Gan , Saurav Karmakar , Stefan Dietze

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

Computation and Language · Computer Science 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

The practice of fine-tuning Pre-trained Language Models (PLMs) from general or domain-specific data to a specific task with limited resources, has gained popularity within the field of natural language processing (NLP). In this work, we…

Computation and Language · Computer Science 2023-10-31 Samuel Belkadi , Lifeng Han , Yuping Wu , Goran Nenadic

Recent developments in Named Entity Recognition (NER) have resulted in better and better models. However, is there a glass ceiling? Do we know which types of errors are still hard or even impossible to correct? In this paper, we present a…

Computation and Language · Computer Science 2022-11-28 Tomasz Stanislawek , Anna Wróblewska , Alicja Wójcicka , Daniel Ziembicki , Przemyslaw Biecek

Few-shot Named Entity Recognition (NER), the task of identifying named entities with only a limited amount of labeled data, has gained increasing significance in natural language processing. While existing methodologies have shown some…

Computation and Language · Computer Science 2024-08-26 Yafeng Zhang , Zilan Yu , Yuang Huang , Jing Tang

Automatically locating named entities in natural language text - named entity recognition - is an important task in the biomedical domain. Many named entity mentions are ambiguous between several bioconcept types, however, causing text…

Computation and Language · Computer Science 2019-09-24 Chih-Hsuan Wei , Kyubum Lee , Robert Leaman , Zhiyong Lu

Named entity recognition in real-world applications suffers from the diversity of entity types, the emergence of new entity types, and the lack of high-quality annotations. To address the above problems, this paper proposes an in-context…

Computation and Language · Computer Science 2023-05-29 Jiawei Chen , Yaojie Lu , Hongyu Lin , Jie Lou , Wei Jia , Dai Dai , Hua Wu , Boxi Cao , Xianpei Han , Le Sun

Named entity recognition (NER) models often struggle with noisy inputs, such as those with spelling mistakes or errors generated by Optical Character Recognition processes, and learning a robust NER model is challenging. Existing robust NER…

Computation and Language · Computer Science 2024-07-29 Chaoyi Ai , Yong Jiang , Shen Huang , Pengjun Xie , Kewei Tu

Information extraction is an important task in NLP, enabling the automatic extraction of data for relational database filling. Historically, research and data was produced for English text, followed in subsequent years by datasets in…

Computation and Language · Computer Science 2019-12-13 Taesun Moon , Parul Awasthy , Jian Ni , Radu Florian

Zero-resource named entity recognition (NER) severely suffers from data scarcity in a specific domain or language. Most studies on zero-resource NER transfer knowledge from various data by fine-tuning on different auxiliary tasks. However,…

Computation and Language · Computer Science 2021-07-23 Ying Zhang , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou