English
Related papers

Related papers: Biomedical named entity recognition using BERT in …

200 papers

In this work, we propose a two-stage method for named entity recognition (NER), especially for nested NER. We borrowed the idea from the two-stage Object Detection in computer vision and the way how they construct the loss function. First,…

Computation and Language · Computer Science 2021-01-28 Bing Li

Named entity recognition (NER) is an information extraction technique that aims to locate and classify named entities (e.g., organizations, locations,...) within a document into predefined categories. Correctly identifying these phrases…

Computation and Language · Computer Science 2021-12-16 Tran Thi Hong Hanh , Antoine Doucet , Nicolas Sidere , Jose G. Moreno , Senja Pollak

The extraction and analysis of insights from medical data, primarily stored in free-text formats by healthcare workers, presents significant challenges due to its unstructured nature. Medical coding, a crucial process in healthcare, remains…

Computation and Language · Computer Science 2024-05-28 Mikhail Kulyabin , Gleb Sokolov , Aleksandr Galaida , Andreas Maier , Tomas Arias-Vergara

We present a bi-encoder framework for named entity recognition (NER), which applies contrastive learning to map candidate text spans and entity types into the same vector representation space. Prior work predominantly approaches NER as…

Computation and Language · Computer Science 2023-02-24 Sheng Zhang , Hao Cheng , Jianfeng Gao , Hoifung Poon

Entity linking (EL) for biomedical text is typically benchmarked on English-only corpora with flat mentions, leaving the more realistic scenario of nested and multilingual mentions largely unexplored. We present our system for the BioNNE…

Computation and Language · Computer Science 2025-09-15 Chunyu Li , Xindi Zheng , Siqi Liu

MedER refers to the identification of medical entities. It is crucial for extracting structured clinical information from unstructured medical text. Many existing systems rely on transformer-based models, which are computationally expensive…

Computation and Language · Computer Science 2026-05-26 Peyal Saha , Ahsanul Haque Hasib , Shoumik Barman Polok

Named entity recognition (NER) is the task to identify mentions of rigid designators from text belonging to predefined semantic types such as person, location, organization etc. NER always serves as the foundation for many natural language…

Computation and Language · Computer Science 2023-04-26 Jing Li , Aixin Sun , Jianglei Han , Chenliang Li

Biomedical text mining is becoming increasingly important as the number of biomedical documents and web data rapidly grows. Recently, word representation models such as BERT has gained popularity among researchers. However, it is difficult…

Computation and Language · Computer Science 2023-01-26 Ningyu Zhang , Qianghuai Jia , Kangping Yin , Liang Dong , Feng Gao , Nengwei Hua

Neural networks (NNs) have become the state of the art in many machine learning applications, especially in image and sound processing [1]. The same, although to a lesser extent [2,3], could be said in natural language processing (NLP)…

Computation and Language · Computer Science 2019-07-30 Luka Gligic , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado

Named Entity Recognition has traditionally been a key task in natural language processing, aiming to identify and extract important terms from unstructured text data. However, a notable challenge for contemporary deep-learning NER models…

Computation and Language · Computer Science 2025-08-19 Tzu-Chieh Chen , Wen-Yang Lin

When combined with In-Context Learning, a technique that enables models to adapt to new tasks by incorporating task-specific examples or demonstrations directly within the input prompt, autoregressive language models have achieved good…

Computation and Language · Computer Science 2024-10-18 Enzo Shiraishi , Raphael Y. de Camargo , Henrique L. P. Silva , Ronaldo C. Prati

Machine Reading Comprehension (MRC) aims to extract answers to questions given a passage. It has been widely studied recently, especially in open domains. However, few efforts have been made on closed-domain MRC, mainly due to the lack of…

Computation and Language · Computer Science 2021-08-23 Taolin Zhang , Chengyu Wang , Minghui Qiu , Bite Yang , Xiaofeng He , Jun Huang

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations with correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2017-10-31 Diego Esteves , Rafael Peres , Jens Lehmann , Giulio Napolitano

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

In this paper, we present our approach to extracting structured information from unstructured Electronic Health Records (EHR) [2] which can be used to, for example, study adverse drug reactions in patients due to chemicals in their…

Computation and Language · Computer Science 2020-01-30 Amogh Kamat Tarcar , Aashis Tiwari , Vineet Naique Dhaimodker , Penjo Rebelo , Rahul Desai , Dattaraj Rao

Multi-task learning (MTL) has achieved remarkable success in natural language processing applications. In this work, we study a multi-task learning model with multiple decoders on varieties of biomedical and clinical natural language…

Computation and Language · Computer Science 2020-05-07 Yifan Peng , Qingyu Chen , Zhiyong Lu

With the rapid expansion of unstructured clinical texts in electronic health records (EHRs), clinical named entity recognition (NER) has become a crucial technique for extracting medical information. However, traditional supervised models…

Computation and Language · Computer Science 2026-03-31 Xinli Tao , Xin Dong , Xuezhong Zhou

This paper describes our systems for the sub-task I in the Software Mention Detection in Scholarly Publications shared-task. We propose three approaches leveraging different pre-trained language models (BERT, SciBERT, and XLM-R) to tackle…

Software Engineering · Computer Science 2024-05-06 Thuy Nguyen Thi , Anh Nguyen Viet , Thin Dang Van , Ngan Nguyen Luu Thuy

Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest because they can be adaptedto different languages and…

Computation and Language · Computer Science 2024-04-01 Nesrine Bannour , Christophe Servan , Aurélie Névéol , Xavier Tannier

In this work, we explore the way to perform named entity recognition (NER) using only unlabeled data and named entity dictionaries. To this end, we formulate the task as a positive-unlabeled (PU) learning problem and accordingly propose a…

Computation and Language · Computer Science 2019-06-12 Minlong Peng , Xiaoyu Xing , Qi Zhang , Jinlan Fu , Xuanjing Huang