English
Related papers

Related papers: Healthcare NER Models Using Language Model Pretrai…

200 papers

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and…

Computation and Language · Computer Science 2024-09-02 Shubham Agarwal , Thomas Searle , Mart Ratas , Anthony Shek , James Teo , Richard Dobson

Named entity recognition (NER) stands as a fundamental and pivotal task within the realm of Natural Language Processing. Particularly within the domain of Biomedical Method NER, this task presents notable challenges, stemming from the…

Computation and Language · Computer Science 2024-07-01 Chen Tang , Bohao Yang , Kun Zhao , Bo Lv , Chenghao Xiao , Frank Guerin , Chenghua Lin

Large language models (LLMs) have demonstrated dominating performance in many NLP tasks, especially on generative tasks. However, they often fall short in some information extraction tasks, particularly those requiring domain-specific…

Computation and Language · Computer Science 2023-09-22 Junyi Bian , Jiaxuan Zheng , Yuyi Zhang , Shanfeng Zhu

In the biomedical domain, the lack of sharable datasets often limit the possibility of developing natural language processing systems, especially dialogue applications and natural language understanding models. To overcome this issue, we…

Computation and Language · Computer Science 2018-11-30 Antoine Neuraz , Leonardo Campillos Llanos , Anita Burgun , Sophie Rosset

Background: Widespread adoption of electronic health records (EHRs) has enabled secondary use of EHR data for clinical research and healthcare delivery. Natural language processing (NLP) techniques have shown promise in their capability to…

Information Retrieval · Computer Science 2021-06-15 Sijia Liu , Yanshan Wang , Andrew Wen , Liwei Wang , Na Hong , Feichen Shen , Steven Bedrick , William Hersh , Hongfang Liu

Manual chart review remains an extremely time-consuming and resource-intensive component of clinical research, requiring experts to extract often complex information from unstructured electronic health record (EHR) narratives. We present a…

Named entity recognition (NER) aims to identify mentions of named entities in an unstructured text and classify them into predefined named entity classes. While deep learning-based pre-trained language models help to achieve good predictive…

Computation and Language · Computer Science 2023-06-16 Ali Osman Berk Sapci , Oznur Tastan , Reyyan Yeniterzi

Objective: To evaluate the accuracy, computational cost and portability of a new Natural Language Processing (NLP) method for extracting medication information from clinical narratives. Materials and Methods: We propose an original…

Named Entity Recognition (NER) is a critical task that requires substantial annotated data, making it challenging in low-resource scenarios where label acquisition is expensive. While zero-shot and instruction-tuned approaches have made…

Computation and Language · Computer Science 2025-10-21 Nanda Kumar Rengarajan , Jun Yan , Chun Wang

The inherent complexity of structured longitudinal Electronic Health Records (EHR) data poses a significant challenge when integrated with Large Language Models (LLMs), which are traditionally tailored for natural language processing.…

Computation and Language · Computer Science 2024-02-13 Yinghao Zhu , Zixiang Wang , Junyi Gao , Yuning Tong , Jingkun An , Weibin Liao , Ewen M. Harrison , Liantao Ma , Chengwei Pan

Electronic Health Records (EHR)-based disease prediction models have demonstrated significant clinical value in promoting precision medicine and enabling early intervention. However, existing large language models face two major challenges:…

Computation and Language · Computer Science 2025-06-19 Junke Wang , Hongshun Ling , Li Zhang , Longqian Zhang , Fang Wang , Yuan Gao , Zhi Li

Named Entity Recognition (NER) is a critical component of Natural Language Processing with diverse applications in information extraction and conversational AI. However, NER in specific domains for low-resource languages faces challenges…

Computational Engineering, Finance, and Science · Computer Science 2026-05-07 Do Minh Duc , Quan Xuan Truong , Viet Tran Hong , Le Hoang Anh , Mac Thi Minh Tra , Nguyen Van Thuy , Le Hai Ha , Vinh Nguyen Van

Scanned documents in electronic health records (EHR) have been a challenge for decades, and are expected to stay in the foreseeable future. Current approaches for processing often include image preprocessing, optical character recognition…

Computation and Language · Computer Science 2021-10-25 Enshuo Hsu , Ioannis Malagaris , Yong-Fang Kuo , Rizwana Sultana , Kirk Roberts

The use of large pretrained neural networks to create contextualized word embeddings has drastically improved performance on several natural language processing (NLP) tasks. These computationally expensive models have begun to be applied to…

Computers and Society · Computer Science 2019-12-03 Benjamin Clavié , Kobi Gal

A large percentage of medical information is in unstructured text format in electronic medical record systems. Manual extraction of information from clinical notes is extremely time consuming. Natural language processing has been widely…

Information Retrieval · Computer Science 2019-08-16 Dianbo Liu , Dmitriy Dligach , Timothy Miller

Function is increasingly recognized as an important indicator of whole-person health, although it receives little attention in clinical natural language processing research. We introduce the first public annotated dataset specifically on…

Computation and Language · Computer Science 2023-11-28 Tuan-Dung Le , Zhuqi Miao , Samuel Alvarado , Brittany Smith , William Paiva , Thanh Thieu

Despite impressive results of language models for named entity recognition (NER), their generalization to varied textual genres, a growing entity type set, and new entities remains a challenge. Collecting thousands of annotations in each…

Computation and Language · Computer Science 2022-04-28 Elena V. Epure , Romain Hennequin

This study applies Large Language Models (LLMs) to two foundational Electronic Health Record (EHR) data science tasks: structured data querying (using programmatic languages, Python/Pandas) and information extraction from unstructured…

Computation and Language · Computer Science 2026-01-29 Juan Jose Rubio Jan , Jack Wu , Julia Ive

Named entity recognition (NER) identifies typed entity mentions in raw text. While the task is well-established, there is no universally used tagset: often, datasets are annotated for use in downstream applications and accordingly only…

Computation and Language · Computer Science 2019-10-08 Xiao Huang , Li Dong , Elizabeth Boschee , Nanyun Peng

Predicting disease trajectories from electronic health records (EHRs) is a complex task due to major challenges such as data non-stationarity, high granularity of medical codes, and integration of multimodal data. EHRs contain both…

Machine Learning · Computer Science 2025-02-26 Sifal Klioui , Sana Sellami , Youssef Trardi