English
Related papers

Related papers: Multimodal Cancer Survival Analysis via Hypergraph…

200 papers

The integration of pathologic images and genomic data for survival analysis has gained increasing attention with advances in multimodal learning. However, current methods often ignore biological characteristics, such as heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Shuaiyu Zhang , Xun Lin , Rongxiang Zhang , Yu Bai , Yong Xu , Tao Tan , Xunbin Zheng , Zitong Yu

In Computational Pathology (CPath), the introduction of Vision-Language Models (VLMs) has opened new avenues for research, focusing primarily on aligning image-text pairs at a single magnification level. However, this approach might not be…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Shahad Albastaki , Anabia Sohail , Iyyakutti Iyappan Ganapathi , Basit Alawode , Asim Khan , Sajid Javed , Naoufel Werghi , Mohammed Bennamoun , Arif Mahmood

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

We propose a Hierarchical Multi-scale Knowledge-aware Graph Network (HMKGN) that models multi-scale interactions and spatially hierarchical relationships within whole-slide images (WSIs) for cancer prognostication. Unlike conventional…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Bin Xu , Yufei Zhou , Boling Song , Jingwen Sun , Yang Bian , Cheng Lu , Ye Wu , Jianfei Tu , Xiangxue Wang

Most recently, the pathology diagnosis of cancer is shifting to integrating molecular makers with histology features. It is a urgent need for digital pathology methods to effectively integrate molecular markers with histology, which could…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Xiaofei Wang , Stephen Price , Chao Li

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhiceng Shi , Changmiao Wang , Jun Wan , Wenwen Min

Multimodal deep learning models that fuse whole-slide histopathology images with genomic data have achieved strong discriminative performance for cancer survival prediction, as measured by the concordance index. Yet whether the survival…

Machine Learning · Computer Science 2026-04-07 Sajad Ghawami

Prognostic information at diagnosis has important implications for cancer treatment and monitoring. Although cancer staging, histopathological assessment, molecular features, and clinical variables can provide useful prognostic insights,…

There exists unexplained diverse variation within the predefined colon cancer stages using only features either from genomics or histopathological whole slide images as prognostic factors. Unraveling this variation will bring about improved…

Quantitative Methods · Quantitative Biology 2022-12-15 Olalekan Ogundipe , Zeyneb Kurt , Wai Lok Woo

Recent technological advancements have enabled detailed investigation of associations between the molecular architecture and tumor heterogeneity, through multi-source integration of radiological imaging and genomic (radiogenomic) data. In…

Genomics are rapidly transforming medical practice and basic biomedical research, providing insights into disease mechanisms and improving therapeutic strategies, particularly in cancer. The ability to predict the future course of a…

Neural and Evolutionary Computing · Computer Science 2016-09-29 Safoora Yousefi , Congzheng Song , Nelson Nauata , Lee Cooper

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

Risk stratification is a key tool in clinical decision-making, yet current approaches often fail to translate sophisticated survival analysis into actionable clinical criteria. We present a novel method for unsupervised machine learning…

Survival prediction is a critical task in pathology. In clinical practice, pathologists often examine multiple cases, leveraging a broader spectrum of cancer phenotypes to enhance pathological assessment. Despite significant advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xinyang Li , Yi Zhang , Yi Xie , Jianfei Yang , Xi Wang , Hao Chen , Haixian Zhang

Understanding how deep learning models predict oncology patient risk can provide critical insights into disease progression, support clinical decision-making, and pave the way for trustworthy and data-driven precision medicine. Building on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Marvin Sextro , Gabriel Dernbach , Kai Standvoss , Simon Schallenberg , Frederick Klauschen , Klaus-Robert Müller , Maximilian Alber , Lukas Ruff

Learning medical visual representations directly from paired radiology reports has become an emerging topic in representation learning. However, existing medical image-text joint learning methods are limited by instance or local supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Fuying Wang , Yuyin Zhou , Shujun Wang , Varut Vardhanabhuti , Lequan Yu

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian