English
Related papers

Related papers: ClinicalBERT: Modeling Clinical Notes and Predicti…

200 papers

The way we analyse clinical texts has undergone major changes over the last years. The introduction of language models such as BERT led to adaptations for the (bio)medical domain like PubMedBERT and ClinicalBERT. These models rely on large…

Computation and Language · Computer Science 2023-09-15 Tom van Sonsbeek , Xiantong Zhen , Marcel Worring

Concept normalization in free-form texts is a crucial step in every text-mining pipeline. Neural architectures based on Bidirectional Encoder Representations from Transformers (BERT) have achieved state-of-the-art results in the biomedical…

Computation and Language · Computer Science 2021-01-26 Zulfat Miftahutdinov , Artur Kadurin , Roman Kudrin , Elena Tutubalina

In this paper we study the problem of predicting clinical diagnoses from textual Electronic Health Records (EHR) data. We show the importance of this problem in medical community and present comprehensive historical review of the problem…

Computation and Language · Computer Science 2020-09-29 Pavel Blinov , Manvel Avetisian , Vladimir Kokh , Dmitry Umerenkov , Alexander Tuzhilin

Clinical notes contain valuable, context-rich information, but their unstructured format introduces several challenges, including unintended biases (e.g., gender or racial bias), and poor generalization across clinical settings (e.g.,…

Computation and Language · Computer Science 2025-11-18 Karthikeyan K , Raghuveer Thirukovalluru , David Carlson

Understanding deep learning model behavior is critical to accepting machine learning-based decision support systems in the medical community. Previous research has shown that jointly using clinical notes with electronic health record (EHR)…

Machine Learning · Computer Science 2022-12-07 Severin Husmann , Hugo Yèche , Gunnar Rätsch , Rita Kuznetsova

Survival analysis is a technique to predict the times of specific outcomes, and is widely used in predicting the outcomes for intensive care unit (ICU) trauma patients. Recently, deep learning models have drawn increasing attention in…

Artificial Intelligence · Computer Science 2021-03-22 Yun Zhao , Qinghang Hong , Xinlu Zhang , Yu Deng , Yuqing Wang , Linda Petzold

Heart failure hospitalization is a severe burden on healthcare. How to predict and therefore prevent readmission has been a significant challenge in outcomes research. To address this, we propose a deep learning approach to predict…

Computation and Language · Computer Science 2019-12-24 Xiong Liu , Yu Chen , Jay Bae , Hu Li , Joseph Johnston , Todd Sanger

Large pre-trained language models (LMs) have been widely adopted in biomedical and clinical domains, introducing many powerful LMs such as bio-lm and BioELECTRA. However, the applicability of these methods to real clinical use cases is…

Computation and Language · Computer Science 2022-11-16 Samuel Cahyawijaya , Bryan Wilie , Holy Lovenia , Huan Zhong , MingQian Zhong , Yuk-Yu Nancy Ip , Pascale Fung

Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and…

Machine Learning · Computer Science 2020-12-01 Batuhan Bardak , Mehmet Tan

Outcome prediction from clinical text can prevent doctors from overlooking possible risks and help hospitals to plan capacities. We simulate patients at admission time, when decision support can be especially valuable, and contribute a…

Computation and Language · Computer Science 2021-02-09 Betty van Aken , Jens-Michalis Papaioannou , Manuel Mayrdorfer , Klemens Budde , Felix A. Gers , Alexander Löser

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing…

Computation and Language · Computer Science 2021-03-11 Joshua R. Minot , Nicholas Cheney , Marc Maier , Danne C. Elbers , Christopher M. Danforth , Peter Sheridan Dodds

Embedding algorithms are increasingly used to represent clinical concepts in healthcare for improving machine learning tasks such as clinical phenotyping and disease prediction. Recent studies have adapted state-of-the-art bidirectional…

Machine Learning · Computer Science 2021-12-07 Chao Pang , Xinzhuo Jiang , Krishna S Kalluri , Matthew Spotnitz , RuiJun Chen , Adler Perotte , Karthik Natarajan

The shift to electronic medical records (EMRs) has engendered research into machine learning and natural language technologies to analyze patient records, and to predict from these clinical outcomes of interest. Two observations motivate…

Computation and Language · Computer Science 2019-04-09 Sarthak Jain , Ramin Mohammadi , Byron C. Wallace

Clinical notes containing valuable patient information are written by different health care providers with various scientific levels and writing styles. It might be helpful for clinicians and researchers to understand what information is…

Computation and Language · Computer Science 2023-03-17 Hoda Memarzadeh , Nasser Ghadiri , Matthias Samwald , Maryam Lotfi Shahreza

Recent advances in natural language processing (NLP) have been driven bypretrained language models like BERT, RoBERTa, T5, and GPT. Thesemodels excel at understanding complex texts, but biomedical literature, withits domain-specific…

Computation and Language · Computer Science 2025-07-28 K. Sahit Reddy , N. Ragavenderan , Vasanth K. , Ganesh N. Naik , Vishalakshi Prabhu , Nagaraja G. S

Clinician burnout poses a substantial threat to patient safety, particularly in high-acuity intensive care units (ICUs). Existing research predominantly relies on retrospective survey tools or broad electronic health record (EHR) metadata,…

Computation and Language · Computer Science 2025-09-08 Syed Ahmad Chan Bukhari , Fazel Keshtkar , Alyssa Meczkowska

Electronic health records arise from the complex interaction between patients and the healthcare system. This observation process of interactions, referred to as clinical presence, often impacts observed outcomes. When using electronic…

Machine Learning · Computer Science 2025-08-08 Vincent Jeanselme , Glen Martin , Matthew Sperrin , Niels Peek , Brian Tom , Jessica Barrett

In the United States, 25% or greater than 200 billion dollars of hospital spending accounts for administrative costs that involve services for medical coding and billing. With the increasing number of patient records, manual assignment of…

Computation and Language · Computer Science 2020-03-18 A. K. Bhavani Singh , Mounika Guntu , Ananth Reddy Bhimireddy , Judy W. Gichoya , Saptarshi Purkayastha

In this work, we present a novel technique to improve the quality of draft clinical notes for physicians. This technique is concentrated on the ability to model implicit physician conversation styles and note preferences. We also introduce…

Computation and Language · Computer Science 2024-08-08 Nathan Brake , Thomas Schaaf

With the increasing availability of patient data, modern medicine is shifting towards prospective healthcare. Electronic health records offer a variety of information useful for clinical patient characterization and the development of…

Machine Learning · Computer Science 2025-05-27 Fabio Azzalini , Tommaso Dolci , Marco Vagaggini