English
Related papers

Related papers: Multimodal Cancer Survival Analysis via Hypergraph…

200 papers

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

Machine Learning · Computer Science 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as…

Machine Learning · Computer Science 2024-09-05 Zekang Yang , Hong Liu , Xiangdong Wang

Integrating the different data modalities of cancer patients can significantly improve the predictive performance of patient survival. However, most existing methods ignore the simultaneous utilization of rich semantic features at different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Liangrui Pan , Yijun Peng , Yan Li , Yiyi Liang , Liwen Xu , Qingchun Liang , Shaoliang Peng

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

Genomics, especially multi-omics, has made precision medicine feasible. The completion and publicly accessible multi-omics resource with clinical outcome, such as The Cancer Genome Atlas (TCGA) is a great test bed for developing…

Genomics · Quantitative Biology 2020-08-31 Lana X Garmire

Multimodal learning combining pathology images and genomic sequences enhances cancer survival analysis but faces clinical implementation barriers due to limited access to genomic sequencing in under-resourced regions. To enable survival…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Zizhi Chen , Minghao Han , Xukun Zhang , Shuwei Ma , Tao Liu , Xing Wei , Lihua Zhang

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Metadata are general characteristics of the data in a well-curated and condensed format, and have been proven to be useful for decision making, knowledge discovery, and also heterogeneous data organization of biobank. Among all data types…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Wei-Hung Weng , Yuannan Cai , Angela Lin , Fraser Tan , Po-Hsuan Cameron Chen

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representations on both sides of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Amaya Gallagher-Syed , Costantino Pitzalis , Myles J. Lewis , Michael R. Barnes , Gregory Slabaugh

The Cancer Genome Atlas (TCGA) has enabled novel discoveries and served as a large-scale reference dataset in cancer through its harmonized genomics, clinical, and imaging data. Numerous prior studies have developed bespoke deep learning…

Machine Learning · Computer Science 2026-05-11 Steven Song , Morgan Borjigin-Wang , Irene Madejski , Robert L. Grossman

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Histo-genomic multimodal survival prediction has garnered growing attention for its remarkable model performance and potential contributions to precision medicine. However, a significant challenge in clinical practice arises when only…

Machine Learning · Computer Science 2025-03-17 Fengchun Liu , Linghan Cai , Zhikang Wang , Zhiyuan Fan , Jin-gang Yu , Hao Chen , Yongbing Zhang

Current multimodal fusion approaches in computational oncology primarily focus on integrating multi-gigapixel histology whole slide images (WSIs) with genomic or transcriptomic data, demonstrating improved survival prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Manahil Raza , Ayesha Azam , Talha Qaiser , Nasir Rajpoot

Cancers are characterized by remarkable heterogeneity and diverse prognosis. Accurate cancer classification is essential for patient stratification and clinical decision-making. Although digital pathology has been advancing cancer diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Xiaofei Wang , Hanyu Liu , Yupei Zhang , Boyang Zhao , Hao Duan , Wanming Hu , Yonggao Mou , Stephen Price , Chao Li

Survival prediction is a crucial task associated with cancer diagnosis and treatment planning. This paper presents a novel approach to survival prediction by harnessing comprehensive information from CT and PET scans, along with associated…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Aiman Farooq , Deepak Mishra , Santanu Chaudhury