English
Related papers

Related papers: Pathology-and-genomics Multimodal Transformer for …

200 papers

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Multimodal pathology-genomic analysis has become increasingly prominent in cancer survival prediction. However, existing studies mainly utilize multi-instance learning to aggregate patch-level features, neglecting the information loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mingcheng Qu , Guang Yang , Donglin Di , Tonghua Su , Yue Gao , Yang Song , Lei Fan

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed across interacting genes and pathways. We propose PathMoG, a pathway-centric modular graph…

Machine Learning · Computer Science 2026-04-28 Di Wang , Chupei Tang , Junxiao Kong , Jixiu Zhai , Moyu Tang , Tianchi Lu

Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates. To enhance prediction accuracy, previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic…

Machine Learning · Computer Science 2025-02-04 Jie Peng , Shuang Zhou , Longwei Yang , Yiran Song , Mohan Zhang , Kaixiong Zhou , Feng Xie , Mingquan Lin , Rui Zhang , Tianlong Chen

The integration of multi-modal data, such as pathological images and genomic data, is essential for understanding cancer heterogeneity and complexity for personalized treatments, as well as for enhancing survival predictions. Despite the…

Quantitative Methods · Quantitative Biology 2023-01-09 Lin Qiu , Aminollah Khormali , Kai Liu

Current multimodal fusion approaches in computational oncology primarily focus on integrating multi-gigapixel histology whole slide images (WSIs) with genomic or transcriptomic data, demonstrating improved survival prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Manahil Raza , Ayesha Azam , Talha Qaiser , Nasir Rajpoot

Genomics, especially multi-omics, has made precision medicine feasible. The completion and publicly accessible multi-omics resource with clinical outcome, such as The Cancer Genome Atlas (TCGA) is a great test bed for developing…

Genomics · Quantitative Biology 2020-08-31 Lana X Garmire

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

Multimodal machine learning integrating histopathology and molecular data shows promise for cancer prognostication. We systematically reviewed studies combining whole slide images (WSIs) and high-throughput omics to predict overall…

Quantitative Methods · Quantitative Biology 2025-07-30 Charlotte Jennings , Andrew Broad , Lucy Godson , Emily Clarke , David Westhead , Darren Treanor

Accurate survival prediction is essential for personalized cancer treatment. However, genomic data - often a more powerful predictor than pathology data - is costly and inaccessible. We present the cross-modal genomic feature translation…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Akhila Krishna , Nikhil Cherian Kurian , Abhijeet Patil , Amruta Parulekar , Amit Sethi

Multimodal pathology-genomic analysis is critical for cancer survival prediction. However, existing approaches predominantly integrate formalin-fixed paraffin-embedded (FFPE) slides with genomic data, while neglecting the availability of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Mingcheng Qu , Guang Yang , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

When oncologists estimate cancer patient survival, they rely on multimodal data. Even though some multimodal deep learning methods have been proposed in the literature, the majority rely on having two or more independent networks that share…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Numan Saeed , Ikboljon Sobirov , Roba Al Majzoub , Mohammad Yaqub

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representations on both sides of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Amaya Gallagher-Syed , Costantino Pitzalis , Myles J. Lewis , Michael R. Barnes , Gregory Slabaugh

Survival prediction is a crucial task associated with cancer diagnosis and treatment planning. This paper presents a novel approach to survival prediction by harnessing comprehensive information from CT and PET scans, along with associated…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Aiman Farooq , Deepak Mishra , Santanu Chaudhury

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

Quantitative Methods · Quantitative Biology 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics…

Machine Learning · Computer Science 2023-06-16 Matteo Tortora , Ermanno Cordelli , Rosa Sicilia , Lorenzo Nibid , Edy Ippolito , Giuseppe Perrone , Sara Ramella , Paolo Soda

Integrating cross-department multi-modal data (e.g., radiological, pathological, genomic, and clinical data) is ubiquitous in brain cancer diagnosis and survival prediction. To date, such an integration is typically conducted by human…

Machine Learning · Computer Science 2022-07-20 Can Cui , Han Liu , Quan Liu , Ruining Deng , Zuhayr Asad , Yaohong WangShilin Zhao , Haichun Yang , Bennett A. Landman , Yuankai Huo
‹ Prev 1 2 3 10 Next ›