English
Related papers

Related papers: Systematic Comparative Analysis of Large Pretraine…

200 papers

Recent advances in natural language processing (NLP) can be largely attributed to the advent of pre-trained language models such as BERT and RoBERTa. While these models demonstrate remarkable performance on general datasets, they can…

The extraction of critical patient information from Electronic Health Records (EHRs) poses significant challenges due to the complexity and unstructured nature of the data. Traditional machine learning approaches often fail to capture…

Computation and Language · Computer Science 2025-09-03 Zhimeng Luo , Abhibha Gupta , Adam Frisch , Daqing He

The objective of our work is to demonstrate the feasibility of utilizing deep learning models to extract safety signals related to the use of dietary supplements (DS) in clinical text. Two tasks were performed in this study. For the named…

Information Retrieval · Computer Science 2020-11-24 Yadan Fan , Sicheng Zhou , Yifan Li , Rui Zhang

Electronic health records (EHRs) are designed to synthesize diverse data types, including unstructured clinical notes, structured lab tests, and time-series visit data. Physicians draw on these multimodal and temporal sources of EHR data to…

Clinical interactions are initially recorded and documented in free text medical notes. ICD coding is the task of classifying and coding all diagnoses, symptoms and procedures associated with a patient's visit. The process is often manual…

Information Retrieval · Computer Science 2020-06-09 Zachariah Zhang , Jingshu Liu , Narges Razavian

Medication errors most commonly occur at the ordering or prescribing stage, potentially leading to medical complications and poor health outcomes. While it is possible to catch these errors using different techniques; the focus of this work…

Computation and Language · Computer Science 2022-01-11 Yu Jiang , Christian Poellabauer

The use of large pretrained neural networks to create contextualized word embeddings has drastically improved performance on several natural language processing (NLP) tasks. These computationally expensive models have begun to be applied to…

Computers and Society · Computer Science 2019-12-03 Benjamin Clavié , Kobi Gal

With widespread adoption of electronic health records, there is an increased emphasis for predictive models that can effectively deal with clinical time-series data. Powered by Recurrent Neural Network (RNN) architectures with Long…

Machine Learning · Statistics 2018-07-17 Huan Song , Deepta Rajan , Jayaraman J. Thiagarajan , Andreas Spanias

The shift to electronic medical records (EMRs) has engendered research into machine learning and natural language technologies to analyze patient records, and to predict from these clinical outcomes of interest. Two observations motivate…

Computation and Language · Computer Science 2019-04-09 Sarthak Jain , Ramin Mohammadi , Byron C. Wallace

Automatic relationship extraction (RE) from biomedical literature is critical for managing the vast amount of scientific knowledge produced each year. In recent years, utilizing pre-trained language models (PLMs) has become the prevalent…

Computation and Language · Computer Science 2025-11-04 Mario Sänger , Ulf Leser

Large language models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), especially in domains where labeled data is scarce or expensive, such as clinical domain. However, to unlock the clinical knowledge hidden…

Computation and Language · Computer Science 2023-09-18 Sonish Sivarajkumar , Mark Kelley , Alyssa Samolyk-Mazzanti , Shyam Visweswaran , Yanshan Wang

Extracting clinically relevant information from unstructured medical narratives such as admission notes, discharge summaries, and emergency case histories remains a challenge in clinical natural language processing (NLP). Medical Entity…

Artificial Intelligence · Computer Science 2026-04-21 Nwe Ni Win , Jim Basilakis , Steven Thomas , Seyhan Yazar , Laura Pierce , Stephanie Liu , Paul M. Middleton , Nasser Ghadiri , X. Rosalind Wang

This work presents our participation in the EvalLLM 2025 challenge on biomedical Named Entity Recognition (NER) and health event extraction in French (few-shot setting). For NER, we propose three approaches combining large language models…

In medical information extraction, medical Named Entity Recognition (NER) is indispensable, playing a crucial role in developing medical knowledge graphs, enhancing medical question-answering systems, and analyzing electronic medical…

Computation and Language · Computer Science 2024-03-26 Xiaojing Du , Hanjie Zhao , Danyan Xing , Yuxiang Jia , Hongying Zan

Due to the exponential growth of biomedical literature, event and relation extraction are important tasks in biomedical text mining. Most work only focus on relation extraction, and detect a single entity pair mention on a short span of…

Computation and Language · Computer Science 2020-05-08 Elaheh ShafieiBavani , Antonio Jimeno Yepes , Xu Zhong , David Martinez Iraola

The extraction and analysis of insights from medical data, primarily stored in free-text formats by healthcare workers, presents significant challenges due to its unstructured nature. Medical coding, a crucial process in healthcare, remains…

Computation and Language · Computer Science 2024-05-28 Mikhail Kulyabin , Gleb Sokolov , Aleksandr Galaida , Andreas Maier , Tomas Arias-Vergara

The practice of fine-tuning Pre-trained Language Models (PLMs) from general or domain-specific data to a specific task with limited resources, has gained popularity within the field of natural language processing (NLP). In this work, we…

Computation and Language · Computer Science 2023-10-31 Samuel Belkadi , Lifeng Han , Yuping Wu , Goran Nenadic

Background: Natural Language Processing (NLP) is widely used to extract clinical insights from Electronic Health Records (EHRs). However, the lack of annotated data, automated tools, and other challenges hinder the full utilisation of NLP…

Computation and Language · Computer Science 2023-06-23 Elias Hossain , Rajib Rana , Niall Higgins , Jeffrey Soar , Prabal Datta Barua , Anthony R. Pisani , Ph. D , Kathryn Turner}

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health…

Computation and Language · Computer Science 2023-12-27 Fahime Shahrokh , Nasser Ghadiri , Rasoul Samani , Milad Moradi