English
Related papers

Related papers: Multimodal Prototyping for cancer survival predict…

200 papers

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics…

Machine Learning · Computer Science 2023-06-16 Matteo Tortora , Ermanno Cordelli , Rosa Sicilia , Lorenzo Nibid , Edy Ippolito , Giuseppe Perrone , Sara Ramella , Paolo Soda

Accurate analysis of histopathological images is critical for disease diagnosis and treatment planning. Whole-slide images (WSIs), which digitize tissue specimens at gigapixel resolution, are fundamental to this process but require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Enhui Chai , Sicheng Chen , Tianyi Zhang , Chad Wong , Kecheng Huang , Zeyu Liu , Fei Xia

Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed across interacting genes and pathways. We propose PathMoG, a pathway-centric modular graph…

Machine Learning · Computer Science 2026-04-28 Di Wang , Chupei Tang , Junxiao Kong , Jixiu Zhai , Moyu Tang , Tianchi Lu

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

The characterization of Tumor MicroEnvironment (TME) is challenging due to its complexity and heterogeneity. Relatively consistent TME characteristics embedded within highly specific tissue features, render them difficult to predict. The…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Fangliangzi Meng , Hongrun Zhang , Ruodan Yan , Guohui Chuai , Chao Li , Qi Liu

Whole-slide images (WSIs) from cancer patients contain rich information that can be used for medical diagnosis or to follow treatment progress. To automate their analysis, numerous deep learning methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Lucas Sancéré , Noémie Moreau , Katarzyna Bozek

Lung cancer has a high rate of recurrence in early-stage patients. Predicting the post-surgical recurrence in lung cancer patients has traditionally been approached using single modality information of genomics or radiology images. We…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Vaishnavi Subramanian , Minh N. Do , Tanveer Syeda-Mahmood

Cancer pathological analysis requires modeling tumor heterogeneity across multiple modalities, primarily through transcriptomics and whole slide imaging (WSI), along with their spatial relations. On one hand, bulk transcriptomics and WSI…

Machine Learning · Computer Science 2026-03-17 Jingkun Yu , Guangkai Shang , Changtao Li , Xun Gong , Tianrui Li , Yazhou He , Zhipeng Luo

Multimodal deep learning has improved prognostic accuracy for brain tumours by integrating histopathology and genomic data, yet the contribution of volumetric MRI within unified survival frameworks remains unexplored. This pilot study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Iain Swift , JingHua Ye

Pathology whole-slide images (WSIs) are widely used for cancer survival analysis because of their comprehensive histopathological information at both cellular and tissue levels, enabling quantitative, large-scale, and prognostically rich…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Yucheng Xing , Ling Huang , Jingying Ma , Ruping Hong , Jiangdong Qiu , Pei Liu , Kai He , Huazhu Fu , Mengling Feng

The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jun Shi , Tong Shu , Zhiguo Jiang , Wei Wang , Haibo Wu , Yushan Zheng

Accurate and interpretable survival analysis remains a core challenge in oncology. With growing multimodal data and the clinical need for transparent models to support validation and trust, this challenge increases in complexity. We propose…

Artificial Intelligence · Computer Science 2025-09-29 Mafalda Malafaia , Peter A. N. Bosman , Coen Rasch , Tanja Alderliesten

Determining lymphoma subtypes is a crucial step for better patient treatment targeting to potentially increase their survival chances. In this context, the existing gold standard diagnosis method, which relies on gene expression technology,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-24 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Marianne Petit , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

Since the emergence of the ImageNet dataset, the pretraining and fine-tuning approach has become widely adopted in computer vision due to the ability of ImageNet-pretrained models to learn a wide variety of visual features. However, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Pablo Meseguer , Rocío del Amor , Adrian Colomer , Valery Naranjo

Whole Slide Image (WSI) MLLMs are difficult to build and deploy because gigapixel slides induce thousands of visual tokens, while only a small fraction of regions is diagnostically relevant. Existing slide-level pathology MLLMs typically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qingqiao Hu , Weimin Lyu , Meilong Xu , Kehan Qi , Xiaoling Hu , Saumya Gupta , Jiawei Zhou , Chao Chen

Whole-slide images (WSIs) in pathology can reach up to 10,000 x 10,000 pixels, posing significant challenges for multimodal large language model (MLLM) due to long context length and high computational demands. Previous methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Weimin Lyu , Qingqiao Hu , Kehan Qi , Zhan Shi , Wentao Huang , Saumya Gupta , Chao Chen

Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yilan Zhang , Yingxue Xu , Jianqi Chen , Fengying Xie , Hao Chen

Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learning (MIL) has…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jun Wang , Yu Mao , Nan Guan , Chun Jason Xue

Accurate classification of pediatric central nervous system tumors remains challenging due to histological complexity and limited training data. While pathology foundation models have advanced whole-slide image (WSI) analysis, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jian Yu , Joakim Nguyen , Jinrui Fang , Awais Naeem , Zeyuan Cao , Sanjay Krishnan , Nicholas Konz , Tianlong Chen , Chandra Krishnan , Hairong Wang , Edward Castillo , Ying Ding , Ankita Shukla