English
Related papers

Related papers: Context-aware Adversarial Training for Name Regula…

200 papers

Despite impressive results of language models for named entity recognition (NER), their generalization to varied textual genres, a growing entity type set, and new entities remains a challenge. Collecting thousands of annotations in each…

Computation and Language · Computer Science 2022-04-28 Elena V. Epure , Romain Hennequin

Named entity recognition (NER) is an information extraction technique that aims to locate and classify named entities (e.g., organizations, locations,...) within a document into predefined categories. Correctly identifying these phrases…

Computation and Language · Computer Science 2021-12-16 Tran Thi Hong Hanh , Antoine Doucet , Nicolas Sidere , Jose G. Moreno , Senja Pollak

We conducted a human subject study of named entity recognition on a noisy corpus of conversational music recommendation queries, with many irregular and novel named entities. We evaluated the human NER linguistic behaviour in these…

Computation and Language · Computer Science 2023-03-14 Elena V. Epure , Romain Hennequin

When combined with In-Context Learning, a technique that enables models to adapt to new tasks by incorporating task-specific examples or demonstrations directly within the input prompt, autoregressive language models have achieved good…

Computation and Language · Computer Science 2024-10-18 Enzo Shiraishi , Raphael Y. de Camargo , Henrique L. P. Silva , Ronaldo C. Prati

Named Entity Recognition task is one of the core tasks of information extraction. Word ambiguity and word abbreviation are important reasons for the low recognition rate of named entities. In this paper, we propose a novel named entity…

Computation and Language · Computer Science 2022-08-16 Renjie Zhou , Qiang Hu , Jian Wan , Jilin Zhang , Qiang Liu , Tianxiang Hu , Jianjun Li

Recognizing named entities (NEs) is commonly conducted as a classification problem that predicts a class tag for a word or a NE candidate in a sentence. In shallow structures, categorized features are weighted to support the prediction.…

Computation and Language · Computer Science 2022-02-01 Yanping Chen , Lefei Wu , Qinghua Zheng , Ruizhang Huang , Jun Liu , Liyuan Deng , Junhui Yu , Yongbin Qing , Bo Dong , Ping Chen

Recent advances in language representation using neural networks have made it viable to transfer the learned internal states of a trained model to downstream natural language processing tasks, such as named entity recognition (NER) and…

Computation and Language · Computer Science 2020-02-28 Fábio Souza , Rodrigo Nogueira , Roberto Lotufo

This paper presents a framework for Named Entity Recognition (NER) leveraging the Bidirectional Encoder Representations from Transformers (BERT) model in natural language processing (NLP). NER is a fundamental task in NLP with broad…

Computation and Language · Computer Science 2025-05-06 Mo Sun , Siheng Xiong , Yuankai Cai , Bowen Zuo

Contextual word embeddings such as BERT have achieved state of the art performance in numerous NLP tasks. Since they are optimized to capture the statistical properties of training data, they tend to pick up on and amplify social…

Computation and Language · Computer Science 2019-06-19 Keita Kurita , Nidhi Vyas , Ayush Pareek , Alan W Black , Yulia Tsvetkov

We study the problem of named entity recognition (NER) based on demonstration learning in low-resource scenarios. We identify two issues in demonstration construction and model training. Firstly, existing methods for selecting demonstration…

Computation and Language · Computer Science 2025-07-23 Guowen Yuan , Tien-Hsuan Wu , Lianghao Xia , Ben Kao

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

In the domain of Natural Language Processing (NLP), Named Entity Recognition (NER) stands out as a pivotal mechanism for extracting structured insights from unstructured text. This manuscript offers an exhaustive exploration into the…

Computation and Language · Computer Science 2023-09-26 Kalyani Pakhale

The success of pretrained word embeddings has motivated their use in the biomedical domain, with contextualized embeddings yielding remarkable results in several biomedical NLP tasks. However, there is a lack of research on quantifying…

Computation and Language · Computer Science 2021-07-27 Vladimir Araujo , Andrés Carvallo , Carlos Aspillaga , Camilo Thorne , Denis Parra

Named Entity Recognition (NER) systems often demonstrate great performance on in-distribution data, but perform poorly on examples drawn from a shifted distribution. One way to evaluate the generalization ability of NER models is to use…

Computation and Language · Computer Science 2022-03-22 Aaron Reich , Jiaao Chen , Aastha Agrawal , Yanzhe Zhang , Diyi Yang

This work proposes Recurrent Neural Network (RNN) models to predict structured 'image situations' -- actions and noun entities fulfilling semantic roles related to the action. In contrast to prior work relying on Conditional Random Fields…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Arun Mallya , Svetlana Lazebnik

To combat adversarial spelling mistakes, we propose placing a word recognition model in front of the downstream classifier. Our word recognition models build upon the RNN semi-character architecture, introducing several new backoff…

Computation and Language · Computer Science 2019-08-30 Danish Pruthi , Bhuwan Dhingra , Zachary C. Lipton

More recently, Named Entity Recognition hasachieved great advances aided by pre-trainingapproaches such as BERT. However, currentpre-training techniques focus on building lan-guage modeling objectives to learn a gen-eral representation,…

Computation and Language · Computer Science 2020-10-29 Mengge Xue , Bowen Yu , Zhenyu Zhang , Tingwen Liu , Yue Zhang , Bin Wang

Pretrained contextualized language models such as BERT and T5 have established a new state-of-the-art for ad-hoc search. However, it is not yet well-understood why these methods are so effective, what makes some variants more effective than…

Computation and Language · Computer Science 2023-07-21 Sean MacAvaney , Sergey Feldman , Nazli Goharian , Doug Downey , Arman Cohan

Available training data for named entity recognition (NER) often contains a significant percentage of incorrect labels for entity types and entity boundaries. Such label noise poses challenges for supervised learning and may significantly…

Computation and Language · Computer Science 2024-10-15 Elena Merdjanovska , Ansar Aynetdinov , Alan Akbik

Adversarial training, which minimizes the maximal risk for label-preserving input perturbations, has proved to be effective for improving the generalization of language models. In this work, we propose a novel adversarial training…

Computation and Language · Computer Science 2020-04-24 Chen Zhu , Yu Cheng , Zhe Gan , Siqi Sun , Tom Goldstein , Jingjing Liu