English
Related papers

Related papers: MORE-CLEAR: Multimodal Offline Reinforcement learn…

200 papers

Recent years have seen particular interest in using electronic medical records (EMRs) for secondary purposes to enhance the quality and safety of healthcare delivery. EMRs tend to contain large amounts of valuable clinical notes. Learning…

Computation and Language · Computer Science 2022-07-25 Hoda Memarzadeh , Nasser Ghadiri , Maryam Lotfi Shahreza

The proliferation of early diagnostic technologies, including self-monitoring systems and wearables, coupled with the application of these technologies on large segments of healthy populations may significantly aggravate the problem of…

Machine Learning · Computer Science 2021-07-23 Anna Fedyukova , Douglas Pires , Daniel Capurro

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

Clinical language models are important for many applications in healthcare, but their development depends on access to extensive clinical text for pretraining. However, obtaining clinical notes from electronic health records (EHRs) at scale…

Computation and Language · Computer Science 2024-12-02 Jinghui Liu , Anthony Nguyen

Causal inference from electronic health records (EHR) is fundamentally limited by unmeasured confounding: critical clinical states such as frailty, goals of care, and mental status are documented in free-text notes but absent from…

Machine Learning · Computer Science 2026-04-22 Lei Liu , Jialin Chen , Kathy Macropol

Existing studies on reinforcement learning (RL) for sepsis management have mostly followed an established problem setup, in which patient data are aggregated into 4-hour time steps. Although concerns have been raised regarding the…

Machine Learning · Computer Science 2025-11-27 Yingchuan Sun , Shengpu Tang

Reconstructing precise clinical timelines is essential for modeling patient trajectories and forecasting risk in complex, heterogeneous conditions like sepsis. While unstructured clinical narratives offer semantically rich and contextually…

Computation and Language · Computer Science 2026-05-15 Sayantan Kumar , Shahriar Noroozizadeh , Juyong Kim , Jeremy C. Weiss

Multimodal Object-Entity Relation Extraction (MORE) is a challenging task in information extraction research. It aims to identify relations between visual objects and textual entities, requiring complex multimodal understanding and…

Multimedia · Computer Science 2026-03-11 Xiang Yuan , Xu Chu , Xinrong Chen , Haochen Li , Zonghong Dai , Hongcheng Fan , Xiaoyue Yuan , Weiping Li , Tong Mo

During the diagnostic process, clinicians leverage multimodal information, such as chief complaints, medical images, and laboratory-test results. Deep-learning models for aiding diagnosis have yet to meet this requirement. Here we report a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Hong-Yu Zhou , Yizhou Yu , Chengdi Wang , Shu Zhang , Yuanxu Gao , Jia Pan , Jun Shao , Guangming Lu , Kang Zhang , Weimin Li

Electronic Health Records (EHRs) have been heavily used to predict various downstream clinical tasks such as readmission or mortality. One of the modalities in EHRs, clinical notes, has not been fully explored for these tasks due to its…

Computation and Language · Computer Science 2019-06-05 Bonggun Shin , Julien Hogan , Andrew B. Adams , Raymond J. Lynch , Rachel E. Patzer , Jinho D. Choi

We introduce MediX-R1, an open-ended Reinforcement Learning (RL) framework for medical multimodal large language models (MLLMs) that enables clinically grounded, free-form answers beyond multiple-choice formats. MediX-R1 fine-tunes a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Sahal Shaji Mullappilly , Mohammed Irfan Kurpath , Omair Mohamed , Mohamed Zidan , Fahad Khan , Salman Khan , Rao Anwer , Hisham Cholakkal

Accurate prediction of clinical outcomes using Electronic Health Records (EHRs) is critical for early intervention, efficient resource allocation, and improved patient care. EHRs contain multimodal data, including both structured data and…

Machine Learning · Computer Science 2025-08-29 Rituparna Datta , Jiaming Cui , Zihan Guan , Vishal G. Reddy , Joshua C. Eby , Gregory Madden , Rupesh Silwal , Anil Vullikanti

A large and diverse set of measurements are regularly collected during a patient's hospital stay to monitor their health status. Tools for integrating these measurements into severity scores, that accurately track changes in illness…

Artificial Intelligence · Computer Science 2015-11-13 Kirill Dyagilev , Suchi Saria

The increasing complexity of clinical decision-making, alongside the rapid expansion of electronic health records (EHR), presents both opportunities and challenges for delivering data-informed care. This paper proposes a clinical decision…

Artificial Intelligence · Computer Science 2025-10-03 Leon Garza , Anantaa Kotal , Michael A. Grasso , Emre Umucu

Safe and interpretable sequential decision-making is critical in healthcare, yet reinforcement learning (RL) policies for sepsis treatment optimization remain opaque and difficult to verify. Standard probabilistic model checkers operate on…

Artificial Intelligence · Computer Science 2026-02-17 Dennis Gross

General Multimodal Large Language Models (MLLMs) often underperform in capturing domain-specific nuances in medical diagnosis, trailing behind fully supervised baselines. Although fine-tuning provides a remedy, the high costs of expert…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Wenkai Zhao , Zipei Wang , Mengjie Fang , Di Dong , Jie Tian , Lingwei Zhang

This study introduces a novel teacher-student architecture utilizing Large Language Models (LLMs) to improve prostate cancer radiotherapy symptom extraction from clinical notes. Mixtral, the student model, initially extracts symptoms,…

Generative medical vision-language models~(Med-VLMs) are primarily designed to generate complex textual information~(e.g., diagnostic reports) from multimodal inputs including vision modality~(e.g., medical images) and language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhiyu Xue , Reza Abbasi-Asl , Ramtin Pedarsani

Sepsis-induced acute respiratory failure (ARF) is a serious complication with a poor prognosis. This paper presents a deep representation learningbased phenotyping method to identify distinct groups of clinical trajectories of septic…

Signal Processing · Electrical Eng. & Systems 2024-05-07 Alan Wu , Tilendra Choudhary , Pulakesh Upadhyaya , Ayman Ali , Philip Yang , Rishikesan Kamaleswaran

Accurate disease classification from radiology reports is essential for many applications. While supervised fine-tuning (SFT) of lightweight LLMs improves accuracy, it can degrade reasoning. We propose a two-stage approach: SFT on disease…

Artificial Intelligence · Computer Science 2026-04-22 Yishu Wei , Yi Lin , Adam Flanders , George Shih , Yifan Peng