English
Related papers

Related papers: Preserving Empirical Probabilities in BERT for Sma…

200 papers

In many scenarios, named entity recognition (NER) models severely suffer from unlabeled entity problem, where the entities of a sentence may not be fully annotated. Through empirical studies performed on synthetic datasets, we find two…

Computation and Language · Computer Science 2021-03-19 Yangming Li , Lemao Liu , Shuming Shi

Named entity recognition (NER) models generally perform poorly when large training datasets are unavailable for low-resource domains. Recently, pre-training a large-scale language model has become a promising direction for coping with the…

Computation and Language · Computer Science 2021-12-02 Zihan Liu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Most Named Entity Recognition (NER) models operate under the assumption that training datasets are fully labelled. While it is valid for established datasets like CoNLL 2003 and OntoNotes, sometimes it is not feasible to obtain the complete…

Computation and Language · Computer Science 2022-11-29 Viktor Scherbakov , Vladimir Mayorov

Recent approaches based on artificial neural networks (ANNs) have shown promising results for named-entity recognition (NER). In order to achieve high performances, ANNs need to be trained on a large labeled dataset. However, labels might…

Computation and Language · Computer Science 2017-05-18 Ji Young Lee , Franck Dernoncourt , Peter Szolovits

Clinical notes contain valuable unstructured information. Named entity recognition (NER) enables the automatic extraction of medical concepts; however, benchmarks for Portuguese remain scarce. In this study, we aimed to evaluate BERT-based…

For several purposes in Natural Language Processing (NLP), such as Information Extraction, Sentiment Analysis or Chatbot, Named Entity Recognition (NER) holds an important role as it helps to determine and categorize entities in text into…

Computation and Language · Computer Science 2020-03-24 Thong Nguyen , Duy Nguyen , Pramod Rao

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

Computation and Language · Computer Science 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

Named entity recognition (NER) aims to identify mentions of named entities in an unstructured text and classify them into predefined named entity classes. While deep learning-based pre-trained language models help to achieve good predictive…

Computation and Language · Computer Science 2023-06-16 Ali Osman Berk Sapci , Oznur Tastan , Reyyan Yeniterzi

Named Entity Recognition (NER) or the extraction of concepts from clinical text is the task of identifying entities in text and slotting them into categories such as problems, treatments, tests, clinical departments, occurrences (such as…

Computation and Language · Computer Science 2022-08-31 Namrata Nath , Sang-Heon Lee , Ivan Lee

Clinical dataset labels are rarely certain as annotators disagree and confidence is not uniform across cases. Typical aggregation procedures, such as majority voting, obscure this variability. In simple experiments on medical imaging…

Supervised models trained to predict properties from representations have been achieving high accuracy on a variety of tasks. For instance, the BERT family seems to work exceptionally well on the downstream task from NER tagging to the…

Computation and Language · Computer Science 2020-12-22 Tejas Vaidhya , Ayush Kaushal

Neural Networks can perform poorly when the training label distribution is heavily imbalanced, as well as when the testing data differs from the training distribution. In order to deal with shift in the testing label distribution, which…

Machine Learning · Computer Science 2020-10-23 Junjiao Tian , Yen-Cheng Liu , Nathan Glaser , Yen-Chang Hsu , Zsolt Kira

We evaluate named entity representations of BERT-based NLP models by investigating their robustness to replacements from the same typed class in the input. We highlight that on several tasks while such perturbations are natural, state of…

Computation and Language · Computer Science 2020-07-15 Sriram Balasubramanian , Naman Jain , Gaurav Jindal , Abhijeet Awasthi , Sunita Sarawagi

We study the problem of few shot learning for named entity recognition. Specifically, we leverage the semantic information in the names of the labels as a way of giving the model additional signal and enriched priors. We propose a neural…

Computation and Language · Computer Science 2022-03-18 Jie Ma , Miguel Ballesteros , Srikanth Doss , Rishita Anubhai , Sunil Mallya , Yaser Al-Onaizan , Dan Roth

Available training data for named entity recognition (NER) often contains a significant percentage of incorrect labels for entity types and entity boundaries. Such label noise poses challenges for supervised learning and may significantly…

Computation and Language · Computer Science 2024-10-15 Elena Merdjanovska , Ansar Aynetdinov , Alan Akbik

In this study, we compared the performance of four different methods for multi label text classification using a specific imbalanced business dataset. The four methods we evaluated were fine tuned BERT, Binary Relevance, Classifier Chains,…

Information Retrieval · Computer Science 2023-06-13 Muhammad Arslan , Christophe Cruz

Named entity recognition (NER) has been one of the essential preliminary steps in modern NLP applications. This report focuses on implementing the NER task on finetuning two pretrained models: (i) an encoder-only model (BERT) with a simple…

Computation and Language · Computer Science 2026-05-19 Mei Jia

Named Entity Recognition (NER) serves as a foundational component in many natural language processing (NLP) pipelines. However, current NER models typically output a single predicted label sequence without any accompanying measure of…

Computation and Language · Computer Science 2026-01-27 Matthew Singer , Srijan Sengupta , Karl Pazdernik

Training a Named Entity Recognition (NER) model often involves fixing a taxonomy of entity types. However, requirements evolve and we might need the NER model to recognize additional entity types. A simple approach is to re-annotate entire…

State of the art Named Entity Recognition (NER) models have achieved an impressive ability to extract common phrases from text that belong to labels such as location, organization, time, and person. However, typical NER systems that rely on…

Computation and Language · Computer Science 2024-01-24 Alexandra Loessberg-Zahl
‹ Prev 1 2 3 10 Next ›