English
Related papers

Related papers: A Unified Model for Longitudinal Multi-Modal Multi…

200 papers

Joint models for longitudinal and time-to-event data are commonly used in longitudinal studies to forecast disease trajectories over time. Despite the many advantages of joint modeling, the standard forms suffer from limitations that arise…

Machine Learning · Statistics 2018-07-10 Bryan Lim , Mihaela van der Schaar

Alzheimer's disease, a neurodegenerative disorder, is associated with neural, genetic, and proteomic factors while affecting multiple cognitive and behavioral faculties. Traditional AD prediction largely focuses on univariate disease…

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

Machine Learning · Computer Science 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Objective: To transform heterogeneous clinical data from electronic health records into clinically meaningful constructed features using data driven method that rely, in part, on temporal relations among data. Materials and Methods: The…

Machine Learning · Computer Science 2017-06-22 Edward Choi , Andy Schuetz , Walter F. Stewart , Jimeng Sun

Joint models initially dedicated to a single longitudinal marker and a single time-to-event need to be extended to account for the rich longitudinal data of cohort studies. Multiple causes of clinical progression are indeed usually…

Applications · Statistics 2016-01-26 Cécile Proust-Lima , Jean-François Dartigues , Hélène Jacqmin-Gadda

Longitudinal data are important in numerous fields, such as healthcare, sociology and seismology, but real-world datasets present notable challenges for practitioners because they can be high-dimensional, contain structured missingness…

Machine Learning · Computer Science 2024-07-01 Maksim Sinelnikov , Manuel Haussmann , Harri Lähdesmäki

Dealing with missing modalities in Magnetic Resonance Imaging (MRI) and overcoming their negative repercussions is considered a hurdle in biomedical imaging. The combination of a specified set of modalities, which is selected depending on…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Reza Azad , Nika Khosravi , Mohammad Dehghanmanshadi , Julien Cohen-Adad , Dorit Merhof

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Qi Wu , Yong Xia

Effectively modeling irregularly sampled longitudinal data is essential for understanding disease progression and improving risk prediction. We propose a two-view mixture model that integrates static baseline covariates and longitudinal…

Quantitative Methods · Quantitative Biology 2026-04-03 Shen Jia , David Selby , Mark A Little , Tin Lok James Ng

Multi-modal co-learning is emerging as an effective paradigm in machine learning, enabling models to collaboratively learn from different modalities to enhance single-modality predictions. Earth Observation (EO) represents a quintessential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Francisco Mena , Dino Ienco , Cassio F. Dantas , Roberto Interdonato , Andreas Dengel

Accurate survival prediction from multimodal medical data is essential for precision oncology, yet clinical deployment faces a persistent challenge: modalities are frequently incomplete due to cost constraints, technical limitations, or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kyungwon Kim , Dosik Hwang

The availability of a large amount of electronic health records (EHR) provides huge opportunities to improve health care service by mining these data. One important application is clinical endpoint prediction, which aims to predict whether…

Artificial Intelligence · Computer Science 2018-11-20 Luchen Liu , Jianhao Shen , Ming Zhang , Zichang Wang , Jian Tang

Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and…

Machine Learning · Computer Science 2020-12-01 Batuhan Bardak , Mehmet Tan

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

Over the last few years machine learning has demonstrated groundbreaking results in many areas of medical image analysis, including segmentation. A key assumption, however, is that the train- and test distributions match. We study a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Kenneth Lau , Jonas Adler , Jens Sjölund

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Electronic Health Records (EHRs) contain a large volume of heterogeneous patient data, which are useful at the point of care and for retrospective research. These data are typically stored in relational databases. Gaining an integrated view…

Computers and Society · Computer Science 2018-06-04 Dina Levy-Lambert , Jen J. Gong , Tristan Naumann , Tom J. Pollard , John V. Guttag

Classifying incomplete multi-view data is inevitable since arbitrary view missing widely exists in real-world applications. Although great progress has been achieved, existing incomplete multi-view methods are still difficult to obtain a…

Machine Learning · Computer Science 2023-04-12 Mengyao Xie , Zongbo Han , Changqing Zhang , Yichen Bai , Qinghua Hu

Regular medical records are useful for medical practitioners to analyze and monitor patient health status especially for those with chronic disease, but such records are usually incomplete due to unpunctuality and absence of patients. In…

Longitudinal lesion analysis is crucial for oncological care, yet automated tools often struggle with temporal consistency. While universal lesion segmentation models have advanced, they are typically designed for single time points. This…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Niels Rocholl , Ewoud Smit , Mathias Prokop , Alessa Hering