English
Related papers

Related papers: Training Large Language Models to Predict Clinical…

200 papers

We present a Three-level Hierarchical Transformer Network (3-level-HTN) for modeling long-term dependencies across clinical notes for the purpose of patient-level prediction. The network is equipped with three levels of Transformer-based…

Computation and Language · Computer Science 2021-12-20 Yuqi Si , Kirk Roberts

Intensive care clinicians need reliable clinical practice tools to preempt unexpected critical events that might harm their patients in intensive care units (ICU), to pre-plan timely interventions, and to keep the patient's family well…

Health care is one of the most exciting frontiers in data mining and machine learning. Successful adoption of electronic health records (EHRs) created an explosion in digital clinical data available for analysis, but progress in machine…

Machine Learning · Statistics 2019-08-13 Hrayr Harutyunyan , Hrant Khachatrian , David C. Kale , Greg Ver Steeg , Aram Galstyan

Healthcare data continues to flourish yet a relatively small portion, mostly structured, is being utilized effectively for predicting clinical outcomes. The rich subjective information available in unstructured clinical notes can possibly…

Machine Learning · Computer Science 2019-11-20 Mohammad Hashir , Rapinder Sawhney

Clinical language models are important for many applications in healthcare, but their development depends on access to extensive clinical text for pretraining. However, obtaining clinical notes from electronic health records (EHRs) at scale…

Computation and Language · Computer Science 2024-12-02 Jinghui Liu , Anthony Nguyen

Clinical notes are often stored in unstructured or semi-structured formats after extraction from electronic medical record (EMR) systems, which complicates their use for secondary analysis and downstream clinical applications. Reliable…

Computation and Language · Computer Science 2025-12-30 Risha Surana , Adrian Law , Sunwoo Kim , Rishab Sridhar , Angxiao Han , Peiyu Hong

Clinical notes contain rich patient information, such as diagnoses or medications, making them valuable for patient representation learning. Recent advances in large language models have further improved the ability to extract meaningful…

Machine Learning · Computer Science 2025-09-23 Zihan Liang , Ziwen Pan , Ruoxuan Xiong

Objective: Large language models (LLMs) are attracting increasing interest in healthcare. This commentary evaluates the potential of LLMs to improve clinical prediction models (CPMs) for diagnostic and prognostic tasks, with a focus on…

Computers and Society · Computer Science 2025-11-07 Yusuf Yildiz , Goran Nenadic , Meghna Jani , David A. Jenkins

Timely identification and accurate risk stratification of cardiovascular disease (CVD) remain essential for reducing global mortality. While existing prediction models primarily leverage structured data, unstructured clinical notes contain…

Computation and Language · Computer Science 2025-07-16 Haowei Yang , Ziyu Shen , Junli Shao , Luyao Men , Xinyue Han , Jing Dong

Timely discharge prediction is essential for optimizing bed turnover and resource allocation in elective spine surgery units. This study evaluates the feasibility of lightweight, fine-tuned large language models (LLMs) and traditional…

Artificial Intelligence · Computer Science 2026-04-07 Ha Na Cho , Sairam Sutari , Alexander Lopez , Hansen Bow , Kai Zheng

Chronic diseases such as diabetes are the leading causes of morbidity and mortality worldwide. Numerous research studies have been attempted with various deep learning models in diagnosis. However, most previous studies had certain…

Automated analysis of clinical notes is attracting increasing attention. However, there has not been much work on medical term abbreviation disambiguation. Such abbreviations are abundant, and highly ambiguous, in clinical documents. One of…

Computation and Language · Computer Science 2019-11-01 Irene Li , Michihiro Yasunaga , Muhammed Yavuz Nuzumlalı , Cesar Caraballo , Shiwani Mahajan , Harlan Krumholz , Dragomir Radev

Longitudinal information in radiology reports refers to the sequential tracking of findings across multiple examinations over time, which is crucial for monitoring disease progression and guiding clinical decisions. Many recent automated…

Computation and Language · Computer Science 2026-01-26 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Xin Chen

We explore a lightweight framework that adapts frozen large language models to analyze longitudinal clinical data. The approach integrates patient history and context within the language model space to generate accurate forecasts without…

Computation and Language · Computer Science 2025-10-29 Tananun Songdechakraiwut , Michael Lutz

Unstructured clinical text in EHRs contains crucial information for applications including decision support, trial matching, and retrospective research. Recent work has applied BERT-based models to clinical information extraction and text…

Computation and Language · Computer Science 2020-11-13 Kexin Huang , Sankeerth Garapati , Alexander S. Rich

Outcome prediction from clinical text can prevent doctors from overlooking possible risks and help hospitals to plan capacities. We simulate patients at admission time, when decision support can be especially valuable, and contribute a…

Computation and Language · Computer Science 2021-02-09 Betty van Aken , Jens-Michalis Papaioannou , Manuel Mayrdorfer , Klemens Budde , Felix A. Gers , Alexander Löser

Objective: Clinical knowledge enriched transformer models (e.g., ClinicalBERT) have state-of-the-art results on clinical NLP (natural language processing) tasks. One of the core limitations of these transformer models is the substantial…

Computation and Language · Computer Science 2023-01-30 Yikuan Li , Ramsey M. Wehbe , Faraz S. Ahmad , Hanyin Wang , Yuan Luo

The increasing volume and complexity of clinical documentation in Electronic Medical Records systems pose significant challenges for clinical coders, who must mentally process and summarise vast amounts of clinical text to extract essential…

Computation and Language · Computer Science 2024-09-25 Bokang Bi , Leibo Liu , Sanja Lujic , Louisa Jorm , Oscar Perez-Concha

Multimodal clinical records contain structured measurements and clinical notes recorded over time, offering rich temporal information about the evolution of patient health. Yet these observations are sparse, and whether they are recorded…

Machine Learning · Computer Science 2026-04-24 Zihan Liang , Ziwen Pan , Ruoxuan Xiong

After a patient consultation, a clinician determines the steps in the management of the patient. A clinician may for example request to see the patient again or refer them to a specialist. Whilst most clinicians will record their intent as…