English
Related papers

Related papers: Deep Survival Analysis in Multimodal Medical Data:…

200 papers

An every increasing number of clinical trials features a time-to-event outcome and records non-tabular patient data, such as magnetic resonance imaging or text data in the form of electronic health records. Recently, several neural-network…

Machine Learning · Computer Science 2022-10-24 Gabriele Campanella , Lucas Kook , Ida Häggström , Torsten Hothorn , Thomas J. Fuchs

Accurate survival prediction in head and neck cancer (HNC) is essential for guiding clinical decision-making and optimizing treatment strategies. Traditional models, such as Cox proportional hazards, have been widely used but are limited in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Aiman Farooq , Utkarsh Sharma , Deepak Mishra

There has been increasing interest in modelling survival data using deep learning methods in medical research. Current approaches have focused on designing special cost functions to handle censored survival data. We propose a very different…

Machine Learning · Statistics 2020-03-12 Lili Zhao , Dai Feng

Background: This research aims to improve glioblastoma survival prediction by integrating MR images, clinical and molecular-pathologic data in a transformer-based deep learning model, addressing data heterogeneity and performance…

For personalized medicines, very crucial intrinsic information is present in high dimensional omics data which is difficult to capture due to the large number of molecular features and small number of available samples. Different types of…

Machine Learning · Computer Science 2022-02-04 Sayed Hashim , Muhammad Ali , Karthik Nandakumar , Mohammad Yaqub

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

Effective learning from electronic health records (EHR) data for prediction of clinical outcomes is often challenging because of features recorded at irregular timesteps and loss to follow-up as well as competing events such as death or…

Machine Learning · Computer Science 2022-08-11 Intae Moon , Stefan Groha , Alexander Gusev

Medical datasets and especially biobanks, often contain extensive tabular data with rich clinical information in addition to images. In practice, clinicians typically have less data, both in terms of diversity and scale, but still wish to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Paul Hager , Martin J. Menten , Daniel Rueckert

We introduce NeuralSurv, the first deep survival model to incorporate Bayesian uncertainty quantification. Our non-parametric, architecture-agnostic framework captures time-varying covariate-risk relationships in continuous time via a novel…

Machine Learning · Computer Science 2025-12-17 Mélodie Monod , Alessandro Micheli , Samir Bhatt

Survival models are used in various fields, such as the development of cancer treatment protocols. Although many statistical and machine learning models have been proposed to achieve accurate survival predictions, little attention has been…

Machine Learning · Computer Science 2020-03-26 Hrushikesh Loya , Pranav Poduval , Deepak Anand , Neeraj Kumar , Amit Sethi

Survival analysis is a classic problem in statistics with important applications in healthcare. Most machine learning models for survival analysis are black-box models, limiting their use in healthcare settings where interpretability is…

Machine Learning · Computer Science 2024-11-12 Mike Van Ness , Billy Block , Madeleine Udell

Missing input sequences are common in medical imaging data, posing a challenge for deep learning models reliant on complete input data. In this work, inspired by MultiMAE [2], we develop a masked autoencoder (MAE) paradigm for multi-modal,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Ayhan Can Erdur , Christian Beischl , Daniel Scholz , Jiazhen Pan , Benedikt Wiestler , Daniel Rueckert , Jan C Peeken

In the aftermath of disasters, many institutions worldwide face challenges in monitoring changes in disaster risk, limiting assessment of progress towards the UN Sendai Framework for Disaster Risk Reduction 2015-2030. While numerous efforts…

Machine Learning · Computer Science 2026-05-21 Joshua Dimasaka , Christian Geiß , Robert Muir-Wood , Emily So

Survival analysis plays a crucial role in many healthcare decisions, where the risk prediction for the events of interest can support an informative outlook for a patient's medical journey. Given the existence of data censoring, an…

Machine Learning · Computer Science 2023-09-29 Mohsen Nayebi Kerdabadi , Arya Hadizadeh Moghaddam , Bin Liu , Mei Liu , Zijun Yao

Accurate prognosis for an individual patient is a key component of precision oncology. Recent advances in machine learning have enabled the development of models using a wider range of data, including imaging. Radiomics aims to extract…

Deep-learning survival models for electronic health record (EHR) data are hard to compare across papers because the upstream preprocessing step, which includes cohort definition, time discretisation, missingness handling, and censoring…

Machine Learning · Computer Science 2026-05-13 Munib Mesinovic , Tingting Zhu

To improve the prediction of cancer survival using whole-slide images and transcriptomics data, it is crucial to capture both modality-shared and modality-specific information. However, multimodal frameworks often entangle these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Sanne Abeln , Wilson Silva

Cancer survival prediction is a challenging task that involves analyzing of the tumor microenvironment within Whole Slide Image (WSI). Previous methods cannot effectively capture the intricate interaction features among instances within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zekang Yang , Hong Liu , Xiangdong Wang