English
Related papers

Related papers: Learning Missing Modal Electronic Health Records w…

200 papers

Multimodal physiological data powers clinical AI systems from intensive care units to wearable devices, but sensors routinely fail in practice. Two failure modes are common: modality missing, where an entire channel is absent, and…

Machine Learning · Computer Science 2026-05-18 Wugeng Zheng , Ziwen Kan , Tianlong Chen , Chen Chen , Song Wang

Electronic Health Records (EHRs), which contain patients' medical histories in various multi-modal formats, often overlook the potential for joint reasoning across imaging and table modalities underexplored in current EHR Question Answering…

Computation and Language · Computer Science 2023-12-27 Seongsu Bae , Daeun Kyung , Jaehee Ryu , Eunbyeol Cho , Gyubok Lee , Sunjun Kweon , Jungwoo Oh , Lei Ji , Eric I-Chao Chang , Tackeun Kim , Edward Choi

Modern electronic health records (EHRs) hold immense promise in tracking personalized patient health trajectories through sequential deep learning, owing to their extensive breadth, scale, and temporal granularity. Nonetheless, how to…

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu

Electronic health record (EHR) data has emerged as a valuable resource for analyzing patient health status. However, the prevalence of missing data in EHR poses significant challenges to existing methods, leading to spurious correlations…

Machine Learning · Computer Science 2024-05-16 Zhihao Yu , Xu Chu , Yujie Jin , Yasha Wang , Junfeng Zhao

Many real-world Electronic Health Record (EHR) data contains a large proportion of missing values. Leaving substantial portion of missing information unaddressed usually causes significant bias, which leads to invalid conclusion to be…

Machine Learning · Computer Science 2020-11-04 Lucas J. Liu , Hongwei Zhang , Jianzhong Di , Jin Chen

Multimodal learning, integrating histology images and genomics, promises to enhance precision oncology with comprehensive views at microscopic and molecular levels. However, existing methods may not sufficiently model the shared or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Huahui Yi , Xiaofei Wang , Kang Li , Chao Li

Privacy preservation in AI is crucial, especially in healthcare, where models rely on sensitive patient data. In the emerging field of machine unlearning, existing methodologies struggle to remove patient data from trained multimodal…

Machine Learning · Computer Science 2025-07-01 Shahad Hardan , Darya Taratynova , Abdelmajid Essofi , Karthik Nandakumar , Mohammad Yaqub

Electronic health records (EHRs) are multimodal by nature, consisting of structured tabular features like lab tests and unstructured clinical notes. In real-life clinical practice, doctors use complementary multimodal EHR data sources to…

Computation and Language · Computer Science 2024-07-18 Thao Minh Nguyen Phan , Cong-Tinh Dao , Chenwei Wu , Jian-Zhe Wang , Shun Liu , Jun-En Ding , David Restrepo , Feng Liu , Fang-Ming Hung , Wen-Chih Peng

Providing high-quality item recall for text queries is crucial in large-scale e-commerce search systems. Current Embedding-based Retrieval Systems (ERS) embed queries and items into a shared low-dimensional space, but uni-modality ERS rely…

Information Retrieval · Computer Science 2024-08-28 Hao Jiang , Haoxiang Zhang , Qingshan Hou , Chaofeng Chen , Weisi Lin , Jingchang Zhang , Annan Wang

Healthcare is becoming a more and more important research topic recently. With the growing data in the healthcare domain, it offers a great opportunity for deep learning to improve the quality of medical service. However, the complexity of…

Computation and Language · Computer Science 2021-11-01 Bo Yang , Lijun Wu

Electronic Health Records (EHR) offer rich real-world data for personalized medicine, providing insights into disease progression, treatment responses, and patient outcomes. However, their sparsity, heterogeneity, and high dimensionality…

Methodology · Statistics 2025-05-28 Linshanshan Wang , Mengyan Li , Zongqi Xia , Molei Liu , Tianxi Cai

An active challenge in developing multimodal machine learning (ML) models for healthcare is handling missing modalities during training and deployment. As clinical datasets are inherently temporal and sparse in terms of modality presence,…

Machine Learning · Computer Science 2026-05-08 Andrew Wang , Ellie Pavlick , Ritambhara Singh

In this paper, we propose SimMLM, a simple yet powerful framework for multimodal learning with missing modalities. Unlike existing approaches that rely on sophisticated network architectures or complex data imputation techniques, SimMLM…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sijie Li , Chen Chen , Jungong Han

Electronic Health Records (EHRs) have become increasingly popular to support clinical decision-making and healthcare in recent decades. EHRs usually contain heterogeneous information, such as structural data in tabular form and unstructured…

Machine Learning · Computer Science 2024-03-15 Hejie Cui , Xinyu Fang , Ran Xu , Xuan Kan , Joyce C. Ho , Carl Yang

Clinical notes in Electronic Health Records (EHR) present rich documented information of patients to inference phenotype for disease diagnosis and study patient characteristics for cohort selection. Unsupervised user embedding aims to…

Computation and Language · Computer Science 2022-03-30 Xiaolei Huang , Franck Dernoncourt , Mark Dredze

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

A common assumption in multimodal learning is the completeness of training data, i.e., full modalities are available in all training examples. Although there exists research endeavor in developing novel methods to tackle the incompleteness…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mengmeng Ma , Jian Ren , Long Zhao , Sergey Tulyakov , Cathy Wu , Xi Peng

Electronic health records (EHRs) are increasingly used for clinical and comparative effectiveness research, but suffer from missing data. Motivated by health services research on diabetes care, we seek to increase the quality of EHRs by…

Methodology · Statistics 2020-07-14 Yajuan Si , Mari Palta , Maureen Smith

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma