English
Related papers

Related papers: Deep Survival Analysis in Multimodal Medical Data:…

200 papers

Motivation: Despite advances in the computational analysis of high-throughput molecular profiling assays (e.g. transcriptomics), a dichotomy exists between methods that are simple and interpretable, and ones that are complex but with lower…

Machine Learning · Computer Science 2023-06-12 Pedro Henrique da Costa Avelar , Min Wu , Sophia Tsoka

Survival analysis is crucial for many medical applications, but remains challenging for modern machine learning due to limited data, censoring, and the heterogeneity of tabular covariates. While the prior-fitted paradigm, which relies on…

Machine Learning · Computer Science 2026-05-14 Dmitrii Seletkov , Paul Hager , Georgios Kaissis , Rickmer Braren , Daniel Rueckert , Raphael Rehms

Purpose: Immunotherapies have revolutionized the landscape of cancer treatments. However, our understanding of response patterns in advanced cancers treated with immunotherapy remains limited. By leveraging routinely collected noninvasive…

Pan-cancer classification using transcriptomic (RNA-Seq) data can inform tumor subtyping and therapy selection, but is challenging due to extremely high dimensionality and limited sample sizes. In this study, we propose a novel deep…

Genomics · Quantitative Biology 2025-08-06 Vinil Polepalli

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jiaqi Yang , Wenting Chen , Xiaohan Xing , Sean He , Xiaoling Luo , Xinheng Lyu , Linlin Shen , Guoping Qiu

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

The integration of histology images and gene profiles has shown great promise for improving survival prediction in cancer. However, current approaches often struggle to model intra- and inter-modal interactions efficiently and effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Yilan Zhang , Li Nanbo , Changchun Yang , Jürgen Schmidhuber , Xin Gao

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

Survival prediction is crucial for cancer patients as it provides early prognostic information for treatment planning. Recently, deep survival models based on deep learning and medical images have shown promising performance for survival…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Mingyuan Meng , Lei Bi , Michael Fulham , Dagan Feng , Jinman Kim

Cancer survival analysis commonly integrates information across diverse medical modalities to make survival-time predictions. Existing methods primarily focus on extracting different decoupled features of modalities and performing fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Huayi Wang , Haochao Ying , Yuyang Xu , Qibo Qiu , Cheng Zhang , Danny Z. Chen , Ying Sun , Jian Wu

While tumor dynamic modeling has been widely applied to support the development of oncology drugs, there remains a need to increase predictivity, enable personalized therapy, and improve decision-making. We propose the use of Tumor Dynamic…

Quantitative Methods · Quantitative Biology 2023-10-24 Mark Laurie , James Lu

Survival analysis (SA) is an active field of research that is concerned with time-to-event outcomes and is prevalent in many domains, particularly biomedical applications. Despite its importance, SA remains challenging due to small-scale…

Machine Learning · Statistics 2022-02-16 Philipp Kopper , Simon Wiegrebe , Bernd Bischl , Andreas Bender , David Rügamer

Survival analysis, which estimates the probability of event occurrence over time from censored data, is fundamental in numerous real-world applications, particularly in high-stakes domains such as healthcare and risk assessment. Despite…

Machine Learning · Computer Science 2025-05-26 Yu Liu , Weiyao Tao , Tong Xia , Simon Knight , Tingting Zhu

Immune checkpoint inhibitors (ICIs) have transformed cancer treatment, yet patient responses remain highly variable, and the biological mechanisms underlying resistance are poorly understood. While machine learning models hold promise for…

Machine Learning · Computer Science 2025-08-27 Ifrah Tariq , Ernest Fraenkel

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guillaume Jaume , Anurag Vaidya , Richard Chen , Drew Williamson , Paul Liang , Faisal Mahmood

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as…

Machine Learning · Computer Science 2024-09-05 Zekang Yang , Hong Liu , Xiangdong Wang

Building robust medical machine learning systems requires pretraining strategies that exploit the intrinsic structure present in clinical data. We introduce Multiview Masked Autoencoder (MVMAE), a self-supervised framework that leverages…

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

High-dimensional clinical data have become invaluable resources for genetic studies, due to their accessibility in biobank-scale datasets and the development of high performance modeling techniques especially using deep learning. Recent…

Machine Learning · Computer Science 2023-07-19 Taedong Yun