English
Related papers

Related papers: Multimodal Disease Progression Modeling via Spatio…

200 papers

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Medical vision-language pre-training methods mainly leverage the correspondence between paired medical images and radiological reports. Although multi-view spatial images and temporal sequences of image-report pairs are available in…

Artificial Intelligence · Computer Science 2024-05-31 Jinxia Yang , Bing Su , Wayne Xin Zhao , Ji-Rong Wen

Electronic health record (EHR) data is sparse and irregular as it is recorded at irregular time intervals, and different clinical variables are measured at each observation point. In this work, we propose a multi-view features integration…

Machine Learning · Computer Science 2021-01-27 Yurim Lee , Eunji Jun , Heung-Il Suk

Pretraining multimodal models on Electronic Health Records (EHRs) provides a means of learning representations that can transfer to downstream tasks with minimal supervision. Recent multimodal models induce soft local alignments between…

Machine Learning · Computer Science 2023-02-27 Denis Jered McInerney , Geoffrey Young , Jan-Willem van de Meent , Byron C. Wallace

Rich Electronic Health Records (EHR), have created opportunities to improve clinical processes using machine learning methods. Prediction of the same patient events at different time horizons can have very different applications and…

Machine Learning · Computer Science 2023-03-07 Hao Liu , Muhan Zhang , Zehao Dong , Lecheng Kong , Yixin Chen , Bradley Fritz , Dacheng Tao , Christopher King

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

Early detection of preventable diseases is important for better disease management, improved inter-ventions, and more efficient health-care resource allocation. Various machine learning approacheshave been developed to utilize information…

Machine Learning · Computer Science 2018-08-16 Jingshu Liu , Zachariah Zhang , Narges Razavian

Major depressive disorder (MDD) is a common neuropsychiatric condition whose accurate diagnosis from resting-state functional magnetic resonance imaging (rs-fMRI) remains difficult. Dynamic functional connectivity (DFC) captures…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muhammad Asif Hasan , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Clinical language models have achieved strong performance on downstream tasks by pretraining on domain specific corpora such as discharge summaries and medical notes. However, most approaches treat the electronic health record as a static…

Computation and Language · Computer Science 2025-04-28 Tatsunori Tanaka , Fi Zheng , Kai Sato , Zhifeng Li , Yuanyun Zhang , Shi Li

Multivariate time-series data in numerous real-world applications (e.g., healthcare and industry) are informative but challenging due to the lack of labels and high dimensionality. Recent studies in self-supervised learning have shown their…

Machine Learning · Computer Science 2024-07-18 Ching Chang , Chiao-Tung Chan , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Electronic health record (EHR) systems contain a wealth of multimodal clinical data including structured data like clinical codes and unstructured data such as clinical notes. However, many existing EHR-focused studies has traditionally…

Machine Learning · Statistics 2025-08-20 Tianxi Cai , Feiqing Huang , Ryumei Nakada , Linjun Zhang , Doudou Zhou

Evaluating the clinical similarities between pairwise patients is a fundamental problem in healthcare informatics. A proper patient similarity measure enables various downstream applications, such as cohort study and treatment comparative…

Machine Learning · Statistics 2019-02-12 Zihao Zhu , Changchang Yin , Buyue Qian , Yu Cheng , Jishang Wei , Fei Wang

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Unsupervised anomaly detection (UAD) in medical imaging is crucial for identifying pathological abnormalities without requiring extensive labeled data. However, existing diffusion-based UAD models rely solely on imaging features, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Harim Kim , Yuhan Wang , Minkyu Ahn , Heeyoul Choi , Yuyin Zhou , Charmgil Hong

Clinical outcome prediction based on the Electronic Health Record (EHR) plays a crucial role in improving the quality of healthcare. Conventional deep sequential models fail to capture the rich temporal patterns encoded in the longand…

Machine Learning · Computer Science 2019-08-27 Luchen Liu , Haoran Li , Zhiting Hu , Haoran Shi , Zichang Wang , Jian Tang , Ming Zhang

Accurate prediction of clinical outcomes using Electronic Health Records (EHRs) is critical for early intervention, efficient resource allocation, and improved patient care. EHRs contain multimodal data, including both structured data and…

Machine Learning · Computer Science 2025-08-29 Rituparna Datta , Jiaming Cui , Zihan Guan , Vishal G. Reddy , Joshua C. Eby , Gregory Madden , Rupesh Silwal , Anil Vullikanti

Accurate segmentation of laryngo-pharyngeal tumors is crucial for precise diagnosis and effective treatment planning. However, traditional single-modality imaging methods often fall short of capturing the complex anatomical and pathological…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Junhao Wu , Yun Li , Junhao Li , Jingliang Bian , Xiaomao Fan , Wenbin Lei , Ruxin Wang

Electronic Health Records (EHRs), which contain patients' medical histories in various multi-modal formats, often overlook the potential for joint reasoning across imaging and table modalities underexplored in current EHR Question Answering…

Computation and Language · Computer Science 2023-12-27 Seongsu Bae , Daeun Kyung , Jaehee Ryu , Eunbyeol Cho , Gyubok Lee , Sunjun Kweon , Jungwoo Oh , Lei Ji , Eric I-Chao Chang , Tackeun Kim , Edward Choi

Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare…

Machine Learning · Computer Science 2018-10-24 Edward Choi , Cao Xiao , Walter F. Stewart , Jimeng Sun

Machine learning has revolutionized the modeling of clinical timeseries data. Using machine learning, a Deep Neural Network (DNN) can be automatically trained to learn a complex mapping of its input features for a desired task. This is…

Machine Learning · Computer Science 2024-10-15 Ryan King , Shivesh Kodali , Conrad Krueger , Tianbao Yang , Bobak J. Mortazavi