English
Related papers

Related papers: Path-GPTOmic: A Balanced Multi-modal Learning Fram…

200 papers

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Angelos Chatzimparmpas , Sanne Abeln , Wilson Silva

Recent radiomic studies have witnessed promising performance of deep learning techniques in learning radiomic features and fusing multimodal imaging data. Most existing deep learning based radiomic studies build predictive models in a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Hongming Li , Pamela Boimel , James Janopaul-Naylor , Haoyu Zhong , Ying Xiao , Edgar Ben-Josef , Yong Fan

Prediction of survivability in a patient for tumor progression is useful to estimate the effectiveness of a treatment protocol. In our work, we present a model to take into account the heterogeneous nature of a tumor to predict survival.…

Background: This research aims to improve glioblastoma survival prediction by integrating MR images, clinical and molecular-pathologic data in a transformer-based deep learning model, addressing data heterogeneity and performance…

Accurate prognosis for an individual patient is a key component of precision oncology. Recent advances in machine learning have enabled the development of models using a wider range of data, including imaging. Radiomics aims to extract…

Clinical decision-making in oncology involves multimodal data such as radiology scans, molecular profiling, histopathology slides, and clinical factors. Despite the importance of these modalities individually, no deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Nathaniel Braman , Jacob W. H. Gordon , Emery T. Goossens , Caleb Willis , Martin C. Stumpe , Jagadish Venkataraman

The accurate prognosis of Glioblastoma Multiforme (GBM) plays an essential role in planning correlated surgeries and treatments. The conventional models of survival prediction rely on radiomic features using magnetic resonance imaging…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 Mobarakol Islam , Navodini Wijethilake , Hongliang Ren

Cancer detection and prognosis relies heavily on medical imaging, particularly CT and PET scans. Deep Neural Networks (DNNs) have shown promise in tumor segmentation by fusing information from these modalities. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Numan Saeed , Shahad Hardan , Muhammad Ridzuan , Nada Saadi , Karthik Nandakumar , Mohammad Yaqub

Accurate survival prediction is crucial for development of precision cancer medicine, creating the need for new sources of prognostic information. Recently, there has been significant interest in exploiting routinely collected clinical and…

Machine Learning · Computer Science 2021-03-23 Sejin Kim , Michal Kazmierski , Benjamin Haibe-Kains

Cancer prognosis and survival outcome predictions are crucial for therapeutic response estimation and for stratifying patients into various treatment groups. Medical domains concerned with cancer prognosis are abundant with multiple…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ruining Deng , Nazim Shaikh , Gareth Shannon , Yao Nie

Multimodal learning combining pathology images and genomic sequences enhances cancer survival analysis but faces clinical implementation barriers due to limited access to genomic sequencing in under-resourced regions. To enable survival…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Zizhi Chen , Minghao Han , Xukun Zhang , Shuwei Ma , Tao Liu , Xing Wei , Lihua Zhang

Pathological images play an essential role in cancer prognosis, while survival analysis, which integrates computational techniques, can predict critical clinical events such as patient mortality or disease recurrence from whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Guo Tang , Songhan Jiang , Jinpeng Lu , Linghan Cai , Yongbing Zhang

We built a novel Bayesian hierarchical survival model based on the somatic mutation profile of patients across 50 genes and 27 cancer types. The pan-cancer quality allows for the model to "borrow" information across cancer types, motivated…

Quantitative Methods · Quantitative Biology 2019-10-09 Sarah Samorodnitsky , Katherine A. Hoadley , Eric F. Lock

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

Current multimodal fusion approaches in computational oncology primarily focus on integrating multi-gigapixel histology whole slide images (WSIs) with genomic or transcriptomic data, demonstrating improved survival prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Manahil Raza , Ayesha Azam , Talha Qaiser , Nasir Rajpoot

Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yilan Zhang , Yingxue Xu , Jianqi Chen , Fengying Xie , Hao Chen

Prediction of survival for cancer patients is an open area of research. However, many of these studies focus on datasets with a large number of patients. We present a novel method that is specifically designed to address the challenge of…

Machine Learning · Computer Science 2015-09-30 Hamid Reza Hassanzadeh , John H. Phan , May D. Wang

The analysis of cancer genomic data has long suffered "the curse of dimensionality". Sample sizes for most cancer genomic studies are a few hundreds at most while there are tens of thousands of genomic features studied. Various methods have…

Machine Learning · Statistics 2018-03-14 Li Zeng , Zhaolong Yu , Hongyu Zhao

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang