English
Related papers

Related papers: NER-BERT: A Pre-trained Model for Low-Resource Ent…

200 papers

This paper presents a framework for Named Entity Recognition (NER) leveraging the Bidirectional Encoder Representations from Transformers (BERT) model in natural language processing (NLP). NER is a fundamental task in NLP with broad…

Computation and Language · Computer Science 2025-05-06 Mo Sun , Siheng Xiong , Yuankai Cai , Bowen Zuo

Named entity recognition (NER) is a well-studied task in natural language processing. Traditional NER research only deals with flat entities and ignores nested entities. The span-based methods treat entity recognition as a span…

Computation and Language · Computer Science 2021-07-14 Yongliang Shen , Xinyin Ma , Zeqi Tan , Shuai Zhang , Wen Wang , Weiming Lu

Named Entity Recognition (NER) is a well researched NLP task and is widely used in real world NLP scenarios. NER research typically focuses on the creation of new ways of training NER, with relatively less emphasis on resources and…

Computation and Language · Computer Science 2022-05-05 Sowmya Vajjala , Ramya Balasubramaniam

Most Named Entity Recognition (NER) models operate under the assumption that training datasets are fully labelled. While it is valid for established datasets like CoNLL 2003 and OntoNotes, sometimes it is not feasible to obtain the complete…

Computation and Language · Computer Science 2022-11-29 Viktor Scherbakov , Vladimir Mayorov

Online education platforms are powered by various NLP pipelines, which utilize models like BERT to aid in content curation. Since the inception of the pre-trained language models like BERT, there have also been many efforts toward adapting…

Computation and Language · Computer Science 2022-05-26 Vasu Goel , Dhruv Sahnan , Venktesh V , Gaurav Sharma , Deep Dwivedi , Mukesh Mohania

Named Entity Recognition (NER) is an essential precursor task for many natural language applications, such as relation extraction or event extraction. Much of the NER research has been done on datasets with few classes of entity types (e.g.…

Computation and Language · Computer Science 2020-09-17 Parul Awasthy , Taesun Moon , Jian Ni , Radu Florian

Recent named entity recognition (NER) models often rely on human-annotated datasets, requiring the significant engagement of professional knowledge on the target domain and entities. This research introduces an ask-to-generate approach that…

Computation and Language · Computer Science 2022-11-08 Hyunjae Kim , Jaehyo Yoo , Seunghyun Yoon , Jinhyuk Lee , Jaewoo Kang

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

Named entity recognition (NER) and relation extraction (RE) are two important tasks in information extraction and retrieval (IE \& IR). Recent work has demonstrated that it is beneficial to learn these tasks jointly, which avoids the…

Computation and Language · Computer Science 2020-01-01 John Giorgi , Xindi Wang , Nicola Sahar , Won Young Shin , Gary D. Bader , Bo Wang

Recent breakthroughs of pretrained language models have shown the effectiveness of self-supervised learning for a wide range of natural language processing (NLP) tasks. In addition to standard syntactic and semantic NLP tasks, pretrained…

Computation and Language · Computer Science 2019-12-23 Wenhan Xiong , Jingfei Du , William Yang Wang , Veselin Stoyanov

We propose an efficient modeling framework for cross-lingual named entity recognition in semi-structured text data. Our approach relies on both knowledge distillation and consistency training. The modeling framework leverages knowledge from…

Computation and Language · Computer Science 2023-07-19 Sunisth Kumar , Davide Liu , Alexandre Boulenger

We study the open-domain named entity recognition (NER) problem under distant supervision. The distant supervision, though does not require large amounts of manual annotations, yields highly incomplete and noisy distant labels via external…

Computation and Language · Computer Science 2020-06-30 Chen Liang , Yue Yu , Haoming Jiang , Siawpeng Er , Ruijia Wang , Tuo Zhao , Chao Zhang

Named entity recognition (NER) is the process of recognising and classifying important information (entities) in text. Proper nouns, such as a person's name, an organization's name, or a location's name, are examples of entities. The NER is…

Computation and Language · Computer Science 2023-02-28 Onkar Litake , Maithili Sabane , Parth Patil , Aparna Ranade , Raviraj Joshi

Recent advances in language representation using neural networks have made it viable to transfer the learned internal states of a trained model to downstream natural language processing tasks, such as named entity recognition (NER) and…

Computation and Language · Computer Science 2020-02-28 Fábio Souza , Rodrigo Nogueira , Roberto Lotufo

Named Entity Recognition (NER) encounters the challenge of unbalanced labels, where certain entity types are overrepresented while others are underrepresented in real-world datasets. This imbalance can lead to biased models that perform…

Computation and Language · Computer Science 2024-09-06 Abdul Rehman , Jian Jun Zhang , Xiaosong Yang

The use of BERT, one of the most popular language models, has led to improvements in many Natural Language Processing (NLP) tasks. One such task is Named Entity Recognition (NER) i.e. automatic identification of named entities such as…

Computation and Language · Computer Science 2023-03-10 Harshil Darji , Jelena Mitrović , Michael Granitzer

Transformer language models (TLMs) are critical for most NLP tasks, but they are difficult to create for low-resource languages because of how much pretraining data they require. In this work, we investigate two techniques for training…

Computation and Language · Computer Science 2023-01-06 Luke Gessler , Amir Zeldes

We study the named entity recognition (NER) problem under the extremely weak supervision (XWS) setting, where only one example entity per type is given in a context-free way. While one can see that XWS is lighter than one-shot in terms of…

Computation and Language · Computer Science 2023-11-07 Letian Peng , Zihan Wang , Jingbo Shang

Deep neural network models have been very successfully applied to Natural Language Processing (NLP) and Image based tasks. Their application to network analysis and management tasks is just recently being pursued. Our interest is in…

Networking and Internet Architecture · Computer Science 2022-06-22 Franck Le , Davis Wertheimer , Seraphin Calo , Erich Nahum

This paper reports on the evaluation of Deep Learning (DL) transformer architecture models for Named-Entity Recognition (NER) on ten low-resourced South African (SA) languages. In addition, these DL transformer models were compared to other…

Computation and Language · Computer Science 2022-10-04 Ridewaan Hanslo