English
Related papers

Related papers: From BERT to T5: A Study of Named Entity Recogniti…

200 papers

Named Entity Recognition (NER) performance often degrades rapidly when applied to target domains that differ from the texts observed during training. When in-domain labelled data is available, transfer learning techniques can be used to…

Computation and Language · Computer Science 2020-05-01 Pierre Lison , Aliaksandr Hubin , Jeremy Barnes , Samia Touileb

Named entity recognition (NER) is evolving from a sequence labeling task into a generative paradigm with the rise of large language models (LLMs). We conduct a systematic evaluation of open-source LLMs on both flat and nested NER tasks. We…

Computation and Language · Computer Science 2026-01-27 Qi Zhan , Yile Wang , Hui Huang

Natural language processing (NLP) tasks (text classification, named entity recognition, etc.) have seen revolutionary improvements over the last few years. This is due to language models such as BERT that achieve deep knowledge transfer by…

Computation and Language · Computer Science 2021-05-27 Lee Burke , Karl Pazdernik , Daniel Fortin , Benjamin Wilson , Rustam Goychayev , John Mattingly

We propose a combined three pre-trained language models (XLM-R, BART, and DeBERTa-V3) as an empower of contextualized embedding for named entity recognition. Our model achieves a 92.9% F1 score on the test set and ranks 5th on the…

Computation and Language · Computer Science 2022-12-15 Xuan-Dung Doan

The aim of Named Entity Recognition (NER) is to identify references of named entities in unstructured documents, and to classify them into pre-defined semantic categories. NER often aids from added background knowledge in the form of…

Computation and Language · Computer Science 2015-11-24 S. Thenmalar , J. Balaji , T. V. Geetha

Named entity recognition (NER) systems that perform well require task-related and manually annotated datasets. However, they are expensive to develop, and are thus limited in size. As there already exists a large number of NER datasets that…

Computation and Language · Computer Science 2019-04-23 Nargiza Nosirova , Mingbin Xu , Hui Jiang

As a fundamental natural language processing task and one of core knowledge extraction techniques, named entity recognition (NER) is widely used to extract information from texts for downstream tasks. Nested NER is a branch of NER in which…

Computation and Language · Computer Science 2022-04-19 Yifei Yang , Zuchao Li , Hai Zhao

Recent approaches based on artificial neural networks (ANNs) have shown promising results for named-entity recognition (NER). In order to achieve high performances, ANNs need to be trained on a large labeled dataset. However, labels might…

Computation and Language · Computer Science 2017-05-18 Ji Young Lee , Franck Dernoncourt , Peter Szolovits

In many scenarios, named entity recognition (NER) models severely suffer from unlabeled entity problem, where the entities of a sentence may not be fully annotated. Through empirical studies performed on synthetic datasets, we find two…

Computation and Language · Computer Science 2021-03-19 Yangming Li , Lemao Liu , Shuming Shi

Transformer-based models, specifically BERT, have propelled research in various NLP tasks. However, these models are limited to a maximum token limit of 512 tokens. Consequently, this makes it non-trivial to apply it in a practical setting…

Computation and Language · Computer Science 2023-11-01 Aman Jaiswal , Evangelos Milios

Unsupervised pretraining models have been shown to facilitate a wide range of downstream NLP applications. These models, however, retain some of the limitations of traditional static word embeddings. In particular, they encode only the…

Computation and Language · Computer Science 2020-04-21 Anne Lauscher , Ivan Vulić , Edoardo Maria Ponti , Anna Korhonen , Goran Glavaš

Named entity recognition (NER) for identifying proper nouns in unstructured text is one of the most important and fundamental tasks in natural language processing. However, despite the widespread use of NER models, they still require a…

Computation and Language · Computer Science 2020-12-23 Zhifeng Hao , Di Lv , Zijian Li , Ruichu Cai , Wen Wen , Boyan Xu

Named Entity Recognition (NER) is a machine learning task that traditionally relies on supervised learning and annotated data. Acquiring such data is often a challenge, particularly in specialized fields like medical, legal, and financial…

Computation and Language · Computer Science 2026-04-01 Arthur Elwing Torres , Edleno Silva de Moura , Altigran Soares da Silva , Mario A. Nascimento , Filipe Mesquita

We present a novel approach to named entity recognition (NER) in the presence of scarce data that we call example-based NER. Our train-free few-shot learning approach takes inspiration from question-answering to identify entity spans in a…

Computation and Language · Computer Science 2020-08-25 Morteza Ziyadi , Yuting Sun , Abhishek Goswami , Jade Huang , Weizhu Chen

Cross-domain NER is a practical yet challenging problem since the data scarcity in the real-world scenario. A common practice is first to learn a NER model in a rich-resource general domain and then adapt the model to specific domains. Due…

Computation and Language · Computer Science 2024-08-09 Junhao Zheng , Haibin Chen , Qianli Ma

Recent advances in prompt-based learning have shown strong results on few-shot text classification by using cloze-style templates. Similar attempts have been made on named entity recognition (NER) which manually design templates to predict…

Computation and Language · Computer Science 2022-04-01 Dong-Ho Lee , Akshen Kadakia , Kangmin Tan , Mahak Agarwal , Xinyu Feng , Takashi Shibuya , Ryosuke Mitani , Toshiyuki Sekiya , Jay Pujara , Xiang Ren

A large amount of information in today's world is now stored in knowledge bases. Named Entity Recognition (NER) is a process of extracting, disambiguation, and linking an entity from raw text to insightful and structured knowledge bases.…

Computation and Language · Computer Science 2024-11-11 Monica Munnangi

Deep learning approaches are superior in NLP due to their ability to extract informative features and patterns from languages. The two most successful neural architectures are LSTM and transformers, used in large pretrained language models…

Computation and Language · Computer Science 2022-03-03 Matej Klemen , Luka Krsnik , Marko Robnik-Šikonja

When an entity name contains other names within it, the identification of all combinations of names can become difficult and expensive. We propose a new method to recognize not only outermost named entities but also inner nested ones. We…

Computation and Language · Computer Science 2020-07-13 Takashi Shibuya , Eduard Hovy

Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction. Despite its preliminary effectiveness, the span prediction model's architectural bias has not been fully…

Computation and Language · Computer Science 2021-06-08 Jinlan Fu , Xuanjing Huang , Pengfei Liu