English
Related papers

Related papers: Bridging the gap between Performance and Interpret…

200 papers

Survival analysis stands as a pivotal process in cancer treatment research, crucial for predicting patient survival rates accurately. Recent advancements in data collection techniques have paved the way for enhancing survival predictions by…

Machine Learning · Computer Science 2024-07-26 Linhao Qu , Dan Huang , Shaoting Zhang , Xiaosong Wang

Survival prediction is a crucial task associated with cancer diagnosis and treatment planning. This paper presents a novel approach to survival prediction by harnessing comprehensive information from CT and PET scans, along with associated…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Aiman Farooq , Deepak Mishra , Santanu Chaudhury

Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yilan Zhang , Yingxue Xu , Jianqi Chen , Fengying Xie , Hao Chen

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Current multimodal survival prediction methods typically rely on pathology images (WSIs) and genomic data, both of which are high-dimensional and redundant, making it difficult to extract discriminative features from them and align…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Chenyu Zhao , Yingxue Xu , Fengtao Zhou , Yihui Wang , Hao Chen

Survival prediction is crucial for cancer patients as it provides early prognostic information for treatment planning. Recently, deep survival models based on deep learning and medical images have shown promising performance for survival…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Mingyuan Meng , Lei Bi , Michael Fulham , Dagan Feng , Jinman Kim

Integrating cross-department multi-modal data (e.g., radiological, pathological, genomic, and clinical data) is ubiquitous in brain cancer diagnosis and survival prediction. To date, such an integration is typically conducted by human…

Machine Learning · Computer Science 2022-07-20 Can Cui , Han Liu , Quan Liu , Ruining Deng , Zuhayr Asad , Yaohong WangShilin Zhao , Haichun Yang , Bennett A. Landman , Yuankai Huo

Integrating the different data modalities of cancer patients can significantly improve the predictive performance of patient survival. However, most existing methods ignore the simultaneous utilization of rich semantic features at different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Liangrui Pan , Yijun Peng , Yan Li , Yiyi Liang , Liwen Xu , Qingchun Liang , Shaoliang Peng

Accurate medical image segmentation commonly requires effective learning of the complementary information from multimodal data. However, in clinical practice, we often encounter the problem of missing imaging modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Cheng Chen , Qi Dou , Yueming Jin , Hao Chen , Jing Qin , Pheng-Ann Heng

Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across…

Quantitative Methods · Quantitative Biology 2025-11-17 Seth Alain Chang , Muhammad Mueez Amjad , Noorul Wahab , Ethar Alzaid , Nasir Rajpoot , Adam Shephard

Cancer survival analysis commonly integrates information across diverse medical modalities to make survival-time predictions. Existing methods primarily focus on extracting different decoupled features of modalities and performing fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Huayi Wang , Haochao Ying , Yuyang Xu , Qibo Qiu , Cheng Zhang , Danny Z. Chen , Ying Sun , Jian Wu

Accurate survival prediction in oncology requires integrating diverse imaging modalities to capture the complex interplay of tumor biology. Traditional single-modality approaches often fail to leverage the complementary insights provided by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ho Hin Lee , Alberto Santamaria-Pang , Jameson Merkov , Matthew Lungren , Ivan Tarapov

Survival prediction for esophageal squamous cell cancer (ESCC) is crucial for doctors to assess a patient's condition and tailor treatment plans. The application and development of multi-modal deep learning in this field have attracted…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Chengyu Wu , Yatao Zhang , Yaqi Wang , Qifeng Wang , Shuai Wang

Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yupei Zhang , Yating Huang , Wanming Hu , Lequan Yu , Hujun Yin , Chao Li

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian

Accurate survival prediction is essential for personalised cancer treatment. We propose ModalSurv, a multimodal deep survival framework integrating clinical, MRI, histopathology, and RNA-sequencing data via modality-specific projections and…

Machine Learning · Computer Science 2025-12-19 Noorul Wahab , Ethar Alzaid , Jiaqi Lv , Fayyaz Minhas , Adam Shephard , Shan E Ahmed Raza

In the health domain, decisions are often based on different data modalities. Thus, when creating prediction models, multimodal fusion approaches that can extract and combine relevant features from different data modalities, can be highly…

Artificial Intelligence · Computer Science 2024-02-20 Mafalda Malafaia , Thalea Schlender , Peter A. N. Bosman , Tanja Alderliesten

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guillaume Jaume , Anurag Vaidya , Richard Chen , Drew Williamson , Paul Liang , Faisal Mahmood