English
Related papers

Related papers: Multimodal Foundation Models for Early Disease Det…

200 papers

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiological signals but lack…

Machine Learning · Computer Science 2026-01-21 Yuanyun Zhang , Han Zhou , Li Feng , Yilin Hong , Shi Li

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risks, suggesting…

Machine Learning · Computer Science 2025-08-18 Cindy Shih-Ting Huang , Clarence Boon Liang Ng , Marek Rei

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

Machine Learning · Computer Science 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imaging (clinical test, demographics, etc.) data can be collected together and used for disease prediction. Such diverse data gives complementary information about the…

Machine Learning · Computer Science 2018-12-27 Anees Kazi , S. Arvind krishna , Shayan Shekarforoush , Karsten Kortuem , Shadi Albarqouni , Nassir Navab

Time-series foundation models excel at tasks like forecasting across diverse data types by leveraging informative waveform representations. Wearable sensing data, however, pose unique challenges due to their variability in patterns and…

Machine Learning · Computer Science 2025-05-19 Yunfei Luo , Yuliang Chen , Asif Salekin , Tauhidur Rahman

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

Electronic health records (EHRs) are rich clinical data sources but complex repositories of patient data, spanning structured elements (demographics, vitals, lab results, codes), unstructured clinical notes and other modalities of data.…

Artificial Intelligence · Computer Science 2025-08-25 Sonish Sivarajkumar , Hang Zhang , Yuelyu Ji , Maneesh Bilalpur , Xizhi Wu , Chenyu Li , Min Gu Kwak , Shyam Visweswaran , Yanshan Wang

The widespread application of Electronic Health Records (EHR) data in the medical field has led to early successes in disease risk prediction using deep learning methods. These methods typically require extensive data for training due to…

Machine Learning · Computer Science 2024-11-28 Shibo Li , Hengliang Cheng , Weihua Li

Deep-learning-based clinical decision support using structured electronic health records (EHR) has been an active research area for predicting risks of mortality and diseases. Meanwhile, large amounts of narrative clinical notes provide…

Computation and Language · Computer Science 2023-05-10 Weimin Lyu , Xinyu Dong , Rachel Wong , Songzhu Zheng , Kayley Abell-Hart , Fusheng Wang , Chao Chen

Cardiac biosignals, such as electrocardiograms (ECG) and photoplethysmograms (PPG), are of paramount importance for the diagnosis, prevention, and management of cardiovascular diseases, and have been extensively used in a variety of…

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Background: Electronic Health Records (EHRs) contain rich information of patients' health history, which usually include both structured and unstructured data. There have been many studies focusing on distilling valuable information from…

Machine Learning · Computer Science 2021-11-10 Ziyi Liu , Jiaqi Zhang , Yongshuai Hou , Xinran Zhang , Ge Li , Yang Xiang

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv
‹ Prev 1 2 3 10 Next ›