English
Related papers

Related papers: A Multimodal Data Processing Pipeline for MIMIC-IV…

200 papers

The growing demand for machine learning in healthcare requires processing increasingly large electronic health record (EHR) datasets, but existing pipelines are not computationally efficient or scalable. In this paper, we introduce…

Machine Learning · Computer Science 2024-11-18 Ethan Steinberg , Michael Wornow , Suhana Bedi , Jason Alan Fries , Matthew B. A. McDermott , Nigam H. Shah

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is heterogeneous in…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Baraa Al Jorf , Farah Shamout

The increasing interest in developing Artificial Intelligence applications in the medical domain, suffers from the lack of high-quality data set, mainly due to privacy-related issues. In addition, the recent increase in Vision Language…

Databases · Computer Science 2025-07-18 Irene Siragusa , Salvatore Contino , Massimo La Ciura , Rosario Alicata , Roberto Pirrone

Biomedical research now commonly integrates diverse data types or views from the same individuals to better understand the pathobiology of complex diseases, but the challenge lies in meaningfully integrating these diverse views. Existing…

Machine Learning · Computer Science 2023-12-05 Sarthak Jain , Sandra E. Safo

Recent advancements in multimodal foundation models have showcased impressive capabilities in understanding and reasoning with visual and textual information. Adapting these foundation models trained for general usage to specialized domains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Hejie Cui , Lingjun Mao , Xin Liang , Jieyu Zhang , Hui Ren , Quanzheng Li , Xiang Li , Carl Yang

Electronic health records (EHR) contain a large variety of information on the clinical history of patients such as vital signs, demographics, diagnostic codes and imaging data. The enormous potential for discovery in this rich dataset is…

Effectively leveraging multimodal data such as various images, laboratory tests and clinical information is gaining traction in a variety of AI-based medical diagnosis and prognosis tasks. Most existing multi-modal techniques only focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Yingying Fang , Shuang Wu , Sheng Zhang , Chaoyan Huang , Tieyong Zeng , Xiaodan Xing , Simon Walsh , Guang Yang

Biological function emerges from coupled constraints across sequence, structure, regulation, evolution, and cellular context, yet most foundation models in biology are trained within one modality or for a fixed forward task. We present…

Forecasting how a patient's condition is likely to evolve, including possible deterioration, recovery, treatment needs, and care transitions, could support more proactive and personalized care, but requires modeling heterogeneous and…

Machine Learning · Computer Science 2026-03-26 Chantal Pellegrini , Ege Özsoy , David Bani-Harouni , Matthias Keicher , Nassir Navab

Medical image processing demands specialized software that handles high-dimensional volumetric data, heterogeneous file formats, and domain-specific training procedures. Existing frameworks either provide low-level components that require…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Tianhao Fu , Yucheng Chen

The recent success of machine learning methods applied to time series collected from Intensive Care Units (ICU) exposes the lack of standardized machine learning benchmarks for developing and comparing such methods. While raw datasets, such…

Machine Learning · Computer Science 2022-01-19 Hugo Yèche , Rita Kuznetsova , Marc Zimmermann , Matthias Hüser , Xinrui Lyu , Martin Faltys , Gunnar Rätsch

A crucial component for clinical risk prediction is developing a reliable prediction model is collecting high-quality time series clinical events. In this work, we release such a dataset that consists of 22,588,586 Clinical Time Series…

Artificial Intelligence · Computer Science 2025-11-19 Jing Wang , Xing Niu , Tong Zhang , Jie Shen , Juyong Kim , Jeremy C. Weiss

Medical time-series data captures the dynamic progression of patient conditions, playing a vital role in modern clinical decision support systems. However, real-world clinical data is highly heterogeneous and inconsistently formatted.…

Machine Learning · Computer Science 2026-04-01 Zhongheng Jiang , Yuechao Zhao , Donglin Xie , Chenxi Sun , Rongchen Lu , Silu Luo , Zisheng Liang , Shenda Hong

Electronic Health Record (EHR) provides abundant information through various modalities. However, learning multi-modal EHR is currently facing two major challenges, namely, 1) data embedding and 2) cases with missing modality. A lack of…

Machine Learning · Computer Science 2023-05-05 Kwanhyung Lee , Soojeong Lee , Sangchul Hahn , Heejung Hyun , Edward Choi , Byungeun Ahn , Joohyung Lee

In recent years, human in silico trials have gained significant traction as a powerful approach to evaluate the effects of drugs, clinical interventions, and medical devices. In silico trials not only minimise patient risks but also reduce…

Computational Engineering, Finance, and Science · Computer Science 2025-03-06 Ruben Doste , Julia Camps , Zhinuo Jenny Wang , Lucas Arantes Berg , Maxx Holmes , Hannah Smith , Marcel Beetz , Lei Li , Abhirup Banerjee , Vicente Grau , Blanca Rodriguez

Electrocardiogram (ECG) plays a foundational role in modern cardiovascular care, enabling non-invasive diagnosis of arrhythmias, myocardial ischemia, and conduction disorders. While machine learning has achieved expert-level performance in…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Deyun Zhang , Xiang Lan , Shijia Geng , Qinghao Zhao , Sumei Fan , Mengling Feng , Shenda Hong

Medical imaging and multi-modal clinical settings often face the challange of missing modality in their diagnostic pipelines. Existing imputation methods either lack representational capacity or are computationally expensive. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Afifa Khaled , Ebrahim Hamid Sumiea

The advancements in data acquisition, storage, and processing techniques have resulted in the rapid growth of heterogeneous medical data. Integrating radiological scans, histopathology images, and molecular information with clinical data is…

Machine Learning · Computer Science 2023-12-25 Aakash Tripathi , Asim Waqas , Kavya Venkatesan , Yasin Yilmaz , Ghulam Rasool

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout