English
Related papers

Related papers: Gene-induced Multimodal Pre-training for Image-omi…

200 papers

Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Zhe Wang , Chang Yao

In digital pathology, the multiple instance learning (MIL) strategy is widely used in the weakly supervised histopathology whole slide image (WSI) classification task where giga-pixel WSIs are only labeled at the slide level. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Zhan Shi , Jingwei Zhang , Jun Kong , Fusheng Wang

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

The whole slide image (WSI) classification is often formulated as a multiple instance learning (MIL) problem. Since the positive tissue is only a small fraction of the gigapixel WSI, existing MIL methods intuitively focus on identifying…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenhao Tang , Sheng Huang , Xiaoxian Zhang , Fengtao Zhou , Yi Zhang , Bo Liu

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…

Digital pathology has fundamentally altered diagnostic workflows by enabling the computational analysis of gigapixel Whole Slide Images (WSIs), yet effectively deciphering their complex tumor microenvironments remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xuemei Qiu , Dawei Fan , Yebin Huang , Yanping Chen , Lifang Wei

Survival prediction, utilizing pathological images and genomic profiles, is increasingly important in cancer analysis and prognosis. Despite significant progress, precise survival analysis still faces two main challenges: (1) The massive…

Image and Video Processing · Electrical Eng. & Systems 2024-06-26 Songhan Jiang , Zhengyu Gan , Linghan Cai , Yifeng Wang , Yongbing Zhang

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Sajid Javed , Arif Mahmood , Talha Qaiser , Naoufel Werghi , Nasir Rajpoot

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Predicting genetic mutations from whole slide images is indispensable for cancer diagnosis. However, existing work training multiple binary classification models faces two challenges: (a) Training multiple binary classifiers is inefficient…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Gexin Huang , Chenfei Wu , Mingjie Li , Xiaojun Chang , Ling Chen , Ying Sun , Shen Zhao , Xiaodan Liang , Liang Lin

Whole slide images (WSIs) are the gold standard for pathological diagnosis and sub-typing. Current main-stream two-step frameworks employ offline feature encoders trained without domain-specific knowledge. Among them, attention-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Mingrui Ma , Chentao Li , Pan Huang , Jing Qin

The characterization of Tumor MicroEnvironment (TME) is challenging due to its complexity and heterogeneity. Relatively consistent TME characteristics embedded within highly specific tissue features, render them difficult to predict. The…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Fangliangzi Meng , Hongrun Zhang , Ruodan Yan , Guohui Chuai , Chao Li , Qi Liu

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Junjie Zhou , Wei Shao , Yagao Yue , Wei Mu , Peng Wan , Qi Zhu , Daoqiang Zhang

Cancer subtyping is one of the most challenging tasks in digital pathology, where Multiple Instance Learning (MIL) by processing gigapixel whole slide images (WSIs) has been in the spotlight of recent research. However, MIL approaches do…

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Cheng Jin , Luyang Luo , Huangjing Lin , Jun Hou , Hao Chen

Recent neuroimaging studies that focus on predicting brain disorders via modern machine learning approaches commonly include a single modality and rely on supervised over-parameterized models.However, a single modality provides only a…

Survival analysis using whole-slide images (WSIs) is crucial in cancer research. Despite significant successes, pathology images typically only provide slide-level labels, which hinders the learning of discriminative representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chengsheng Zhang , Linhao Qu , Xiaoyu Liu , Zhijian Song

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large regions of WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shuai Jiang , Liesbeth Hondelink , Arief A. Suriawinata , Saeed Hassanpour