English
Related papers

Related papers: Memory-Augmented Incomplete Multimodal Survival Pr…

200 papers

Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed across interacting genes and pathways. We propose PathMoG, a pathway-centric modular graph…

Machine Learning · Computer Science 2026-04-28 Di Wang , Chupei Tang , Junxiao Kong , Jixiu Zhai , Moyu Tang , Tianchi Lu

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

Accurate survival prediction is critical in oncology for prognosis and treatment planning. Traditional approaches often rely on a single data modality, limiting their ability to capture the complexity of tumor biology. To address this…

Machine Learning · Computer Science 2025-07-11 Alba Garrido , Alejandro Almodóvar , Patricia A. Apellániz , Juan Parras , Santiago Zazo

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

The histopathological analysis of whole-slide images (WSIs) is fundamental to cancer diagnosis but is a time-consuming and expert-driven process. While deep learning methods show promising results, dominant patch-based methods artificially…

Image and Video Processing · Electrical Eng. & Systems 2025-10-08 Alexander Weers , Alexander H. Berger , Laurin Lux , Peter Schüffler , Daniel Rueckert , Johannes C. Paetzold

To enhance the precision of cancer prognosis, recent research has increasingly focused on multimodal survival methods by integrating genomic data and histology images. However, current approaches overlook the fact that the proteome serves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Junjie Zhou , Bao Xue , Meiling Wang , Wei Shao , Daoqiang Zhang

Cancer prognosis and survival outcome predictions are crucial for therapeutic response estimation and for stratifying patients into various treatment groups. Medical domains concerned with cancer prognosis are abundant with multiple…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ruining Deng , Nazim Shaikh , Gareth Shannon , Yao Nie

Due to its superior efficiency in utilizing annotations and addressing gigapixel-sized images, multiple instance learning (MIL) has shown great promise as a framework for whole slide image (WSI) classification in digital pathology…

Quantitative Methods · Quantitative Biology 2023-07-14 Qiehe Sun , Jiawen Li , Jin Xu , Junru Cheng , Tian Guan , Yonghong He

Automatic integration of whole slide images (WSIs) and gene expression profiles has demonstrated substantial potential in precision clinical diagnosis and cancer progression studies. However, most existing studies focus on individual gene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Junzhuo Liu , Xuemei Du , Daniel Reisenbuchler , Ye Chen , Markus Eckstein , Christian Matek , Friedrich Feuerhake , Dorit Merhof

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

When oncologists estimate cancer patient survival, they rely on multimodal data. Even though some multimodal deep learning methods have been proposed in the literature, the majority rely on having two or more independent networks that share…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Numan Saeed , Ikboljon Sobirov , Roba Al Majzoub , Mohammad Yaqub

Whole slide imaging (WSI) has transformed digital pathology by enabling computational analysis of gigapixel histopathology images. Recent foundation model advances have accelerated progress in computational pathology, facilitating joint…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Peihang Wu , Zehong Chen , Lijian Xu

Survival risk stratification is an important step in clinical decision making for breast cancer management. We propose a novel deep learning approach for this purpose by integrating histopathological imaging, genetic and clinical data. It…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guillaume Jaume , Anurag Vaidya , Richard Chen , Drew Williamson , Paul Liang , Faisal Mahmood

Oncologists often rely on a multitude of data, including whole-slide images (WSIs), to guide therapeutic decisions, aiming for the best patient outcome. However, predicting the prognosis of cancer patients can be a challenging task due to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 M Rita Verdelho , Alexandre Bernardino , Catarina Barata

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across…

Quantitative Methods · Quantitative Biology 2025-11-17 Seth Alain Chang , Muhammad Mueez Amjad , Noorul Wahab , Ethar Alzaid , Nasir Rajpoot , Adam Shephard

Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianyi Wang , Jianan Fan , Dingxin Zhang , Dongnan Liu , Yong Xia , Heng Huang , Weidong Cai