English
Related papers

Related papers: Domain specific BERT representation for Named Enti…

200 papers

The Biocreative VII Track-2 challenge consists of named entity recognition, entity-linking (or entity-normalization), and topic indexing tasks -- with entities and topics limited to chemicals for this challenge. Named entity recognition is…

Computation and Language · Computer Science 2021-12-01 Virginia Adams , Hoo-Chang Shin , Carol Anderson , Bo Liu , Anas Abidin

Recent advances in natural language processing (NLP) have been driven bypretrained language models like BERT, RoBERTa, T5, and GPT. Thesemodels excel at understanding complex texts, but biomedical literature, withits domain-specific…

Computation and Language · Computer Science 2025-07-28 K. Sahit Reddy , N. Ragavenderan , Vasanth K. , Ganesh N. Naik , Vishalakshi Prabhu , Nagaraja G. S

Named entity recognition (NER) stands as a fundamental and pivotal task within the realm of Natural Language Processing. Particularly within the domain of Biomedical Method NER, this task presents notable challenges, stemming from the…

Computation and Language · Computer Science 2024-07-01 Chen Tang , Bohao Yang , Kun Zhao , Bo Lv , Chenghao Xiao , Frank Guerin , Chenghua Lin

Named entity recognition (NER) is frequently addressed as a sequence classification task where each input consists of one sentence of text. It is nevertheless clear that useful information for the task can often be found outside of the…

Computation and Language · Computer Science 2020-12-18 Jouni Luoma , Sampo Pyysalo

Biomedical Named Entity Recognition (NER) is a challenging problem in biomedical information processing due to the widespread ambiguity of out of context terms and extensive lexical variations. Performance on bioNER benchmarks continues to…

Computation and Language · Computer Science 2019-08-19 Shreyas Sharma , Ron Daniel

Clinical notes contain valuable unstructured information. Named entity recognition (NER) enables the automatic extraction of medical concepts; however, benchmarks for Portuguese remain scarce. In this study, we aimed to evaluate BERT-based…

Biomedical entity linking aims to map biomedical mentions, such as diseases and drugs, to standard entities in a given knowledge base. The specific challenge in this context is that the same biomedical entity can have a wide range of names,…

Computation and Language · Computer Science 2021-05-25 Lihu Chen , Gaël Varoquaux , Fabian M. Suchanek

Named entity recognition (NER) has been one of the essential preliminary steps in modern NLP applications. This report focuses on implementing the NER task on finetuning two pretrained models: (i) an encoder-only model (BERT) with a simple…

Computation and Language · Computer Science 2026-05-19 Mei Jia

Named Entity Recognition (NER) encounters the challenge of unbalanced labels, where certain entity types are overrepresented while others are underrepresented in real-world datasets. This imbalance can lead to biased models that perform…

Computation and Language · Computer Science 2024-09-06 Abdul Rehman , Jian Jun Zhang , Xiaosong Yang

FDA Medical Device recalls are critical and time-sensitive events, requiring swift identification of impacted devices to inform the public of a recall event and ensure patient safety. The OpenFDA device recall dataset contains valuable…

Computation and Language · Computer Science 2024-06-11 Miriam Farrington

Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general…

Computation and Language · Computer Science 2023-04-04 Renqian Luo , Liai Sun , Yingce Xia , Tao Qin , Sheng Zhang , Hoifung Poon , Tie-Yan Liu

The use of BERT, one of the most popular language models, has led to improvements in many Natural Language Processing (NLP) tasks. One such task is Named Entity Recognition (NER) i.e. automatic identification of named entities such as…

Computation and Language · Computer Science 2023-03-10 Harshil Darji , Jelena Mitrović , Michael Granitzer

Several studies have been carried out on revealing linguistic features captured by BERT. This is usually achieved by training a diagnostic classifier on the representations obtained from different layers of BERT. The subsequent…

Computation and Language · Computer Science 2021-09-14 Hosein Mohebbi , Ali Modarressi , Mohammad Taher Pilehvar

Biomedical entity linking is the task of linking entity mentions in a biomedical document to referent entities in a knowledge base. Recently, many BERT-based models have been introduced for the task. While these models have achieved…

Computation and Language · Computer Science 2021-09-07 Tuan Lai , Heng Ji , ChengXiang Zhai

The availability of biomedical text data and advances in natural language processing (NLP) have made new applications in biomedical NLP possible. Language models trained or fine tuned using domain specific corpora can outperform general…

Computation and Language · Computer Science 2021-07-12 Usman Naseem , Adam G. Dunn , Matloob Khushi , Jinman Kim

Named entity recognition is a key component of Information Extraction (IE), particularly in scientific domains such as biomedicine and chemistry, where large language models (LLMs), e.g., ChatGPT, fall short. We investigate the…

Computation and Language · Computer Science 2024-04-02 Hongyi Liu , Qingyun Wang , Payam Karisani , Heng Ji

Named Entity Recognition (NER) or the extraction of concepts from clinical text is the task of identifying entities in text and slotting them into categories such as problems, treatments, tests, clinical departments, occurrences (such as…

Computation and Language · Computer Science 2022-08-31 Namrata Nath , Sang-Heon Lee , Ivan Lee

Entity linking, the task of mapping textual mentions to known entities, has recently been tackled using contextualized neural networks. We address the question whether these results -- reported for large, high-quality datasets such as…

Computation and Language · Computer Science 2020-05-20 Nadja Kurz , Felix Hamann , Adrian Ulges

Named entity recognition (NER) identifies typed entity mentions in raw text. While the task is well-established, there is no universally used tagset: often, datasets are annotated for use in downstream applications and accordingly only…

Computation and Language · Computer Science 2019-10-08 Xiao Huang , Li Dong , Elizabeth Boschee , Nanyun Peng

We present simple BERT-based models for relation extraction and semantic role labeling. In recent years, state-of-the-art performance has been achieved using neural models by incorporating lexical and syntactic features such as…

Computation and Language · Computer Science 2019-04-11 Peng Shi , Jimmy Lin