English
Related papers

Related papers: M$^3$Care: Learning with Missing Modalities in Mul…

200 papers

The extraction of relevant data from Electronic Health Records (EHRs) is crucial to identifying symptoms and automating epidemiological surveillance processes. By harnessing the vast amount of unstructured text in EHRs, we can detect…

Computation and Language · Computer Science 2025-02-10 Juliano Genari , Guilherme Tegoni Goedert

Embeddings of medical concepts such as medication, procedure and diagnosis codes in Electronic Medical Records (EMRs) are central to healthcare analytics. Previous work on medical concept embedding takes medical concepts and EMRs as words…

Computation and Language · Computer Science 2018-06-11 Xiangrui Cai , Jinyang Gao , Kee Yuan Ngiam , Beng Chin Ooi , Ying Zhang , Xiaojie Yuan

While pioneering deep learning methods have made great strides in analyzing electronic health record (EHR) data, they often struggle to fully capture the semantics of diverse medical codes from limited data. The integration of external…

Machine Learning · Computer Science 2024-08-26 Zhihao Yu , Yujie Jin , Yongxin Xu , Xu Chu , Yasha Wang , Junfeng Zhao

Physical activity and sleep play a major role in the prevention and management of many chronic conditions. It is not a trivial task to understand their impact on chronic conditions. Currently, data from electronic health records (EHRs),…

Machine Learning · Computer Science 2017-12-29 Karan Aggarwal , Shafiq Joty , Luis F. Luque , Jaideep Srivastava

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

Artificial Intelligence · Computer Science 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Despite the potential of multi-modal pre-training to learn highly discriminative feature representations from complementary data modalities, current progress is being slowed by the lack of large-scale modality-diverse datasets. By…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xiao Dong , Xunlin Zhan , Yangxin Wu , Yunchao Wei , Michael C. Kampffmeyer , Xiaoyong Wei , Minlong Lu , Yaowei Wang , Xiaodan Liang

The growing availability of well-organized Electronic Health Records (EHR) data has enabled the development of various machine learning models towards disease risk prediction. However, existing risk prediction methods overlook the…

Machine Learning · Computer Science 2024-06-17 Ziyang Zhang , Hejie Cui , Ran Xu , Yuzhang Xie , Joyce C. Ho , Carl Yang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Electronic health records (EHR) data have considerable variability in data completeness across sites and patients. Lack of "EHR data-continuity" or "EHR data-discontinuity", defined as "having medical information recorded outside the reach…

Electronic Health Records (EHRs) are integral for storing comprehensive patient medical records, combining structured data (e.g., medications) with detailed clinical notes (e.g., physician notes). These elements are essential for…

Computation and Language · Computer Science 2024-12-31 Yeonsu Kwon , Jiho Kim , Gyubok Lee , Seongsu Bae , Daeun Kyung , Wonchul Cha , Tom Pollard , Alistair Johnson , Edward Choi

Missing data arise in most applied settings and are ubiquitous in electronic health records (EHR). When data are missing not at random (MNAR) with respect to measured covariates, sensitivity analyses are often considered. These post-hoc…

Methodology · Statistics 2023-07-11 Alexander W. Levis , Rajarshi Mukherjee , Rui Wang , Heidi Fischer , Sebastien Haneuse

Electronic Health Records (EHR) are generated from clinical routine care recording valuable information of broad patient populations, which provide plentiful opportunities for improving patient management and intervention strategies in…

Machine Learning · Computer Science 2023-04-13 Changshuo Liu , Wenqiao Zhang , Beng Chin Ooi , James Wei Luen Yip , Lingze Zeng , Kaiping Zheng

Multimodal representation learning harmonizes distinct modalities by aligning them into a unified latent space. Recent research generalizes traditional cross-modal alignment to produce enhanced multimodal synergy but requires all modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xiaohao Liu , Xiaobo Xia , Jiaheng Wei , Shuo Yang , Xiu Su , See-Kiong Ng , Tat-Seng Chua

Longitudinal electronic health record (EHR) data offer opportunities to study biomarker trajectories; however, association estimates-the primary inferential target-from standard models designed for regular observation times may be biased by…

Methodology · Statistics 2026-02-18 Cheng-Han Yang , Xu Shi , Bhramar Mukherjee

Medical multi-modal learning is critical for integrating information from a large set of diverse modalities. However, when leveraging a high number of modalities in real clinical applications, it is often impractical to obtain full-modality…

Machine Learning · Computer Science 2026-03-03 Chenwei Wu , Zitao Shuai , Liyue Shen

As the volume of Electronic Health Records (EHR) sharply grows, there has been emerging interest in learning the representation of EHR for healthcare applications. Representation learning of EHR requires appropriate modeling of the two…

Computation and Language · Computer Science 2022-03-21 Sungjin Park , Seongsu Bae , Jiho Kim , Tackeun Kim , Edward Choi

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Multimodal learning has gained increasing importance across various fields, offering the ability to integrate data from diverse sources such as images, text, and personalized records, which are frequently observed in medical domains.…

Machine Learning · Computer Science 2024-11-01 Sukwon Yun , Inyoung Choi , Jie Peng , Yangfan Wu , Jingxuan Bao , Qiyiwen Zhang , Jiayi Xin , Qi Long , Tianlong Chen

Electronic Health Records (EHRs) have been heavily used to predict various downstream clinical tasks such as readmission or mortality. One of the modalities in EHRs, clinical notes, has not been fully explored for these tasks due to its…

Computation and Language · Computer Science 2019-06-05 Bonggun Shin , Julien Hogan , Andrew B. Adams , Raymond J. Lynch , Rachel E. Patzer , Jinho D. Choi