English
Related papers

Related papers: Prototype-driven fusion of pathology and spatial t…

200 papers

Foundation models have recently achieved impressive success in computational pathology, demonstrating strong generalization across diverse histopathology tasks. However, existing models overlook the heterogeneous and non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Di Zhang , Zhangpeng Gong , Xiaobo Pang , Jiashuai Liu , Junbo Lu , Hao Cui , Jiusong Ge , Zhi Zeng , Kai Yi , Yinghua Li , Si Liu , Tingsong Yu , Haoran Wang , Mireia Crispin-Ortuzar , Weimiao Yu , Chen Li , Zeyu Gao

Automated pathology report generation from Whole Slide Images (WSIs) faces two key challenges: (1) lack of semantic content in visual features and (2) inherent information redundancy in WSIs. To address these issues, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ling Zhang , Boxiang Yun , Qingli Li , Yan Wang

Multiple instance learning is an ideal mode of analysis for histopathology data, where vast whole slide images are typically annotated with a single global label. In such cases, a whole slide image is modelled as a collection of tissue…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Leo Fillioux , Joseph Boyd , Maria Vakalopoulou , Paul-Henry Cournède , Stergios Christodoulidis

Due to its superior efficiency in utilizing annotations and addressing gigapixel-sized images, multiple instance learning (MIL) has shown great promise as a framework for whole slide image (WSI) classification in digital pathology…

Quantitative Methods · Quantitative Biology 2023-07-14 Qiehe Sun , Jiawen Li , Jin Xu , Junru Cheng , Tian Guan , Yonghong He

Multimodal pathology-genomic analysis has become increasingly prominent in cancer survival prediction. However, existing studies mainly utilize multi-instance learning to aggregate patch-level features, neglecting the information loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mingcheng Qu , Guang Yang , Donglin Di , Tonghua Su , Yue Gao , Yang Song , Lei Fan

Spatial Transcriptomics (ST) is a method that captures gene expression profiles aligned with spatial coordinates. The discrete spatial distribution and the super-high dimensional sequencing results make ST data challenging to be modeled…

Machine Learning · Computer Science 2025-05-08 Qingtian Zhu , Yumin Zheng , Yuling Sang , Yifan Zhan , Ziyan Zhu , Jun Ding , Yinqiang Zheng

Spatial transcriptomics (ST) maps gene expression within tissue at individual spots, making it a valuable resource for multimodal representation learning. Additionally, ST inherently contains rich hierarchical information both across and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xulin Chen , Junzhou Huang

Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Junjie Zhou , Wei Shao , Yagao Yue , Wei Mu , Peng Wan , Qi Zhu , Daoqiang Zhang

Cancer survival prediction is a challenging task that involves analyzing of the tumor microenvironment within Whole Slide Image (WSI). Previous methods cannot effectively capture the intricate interaction features among instances within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zekang Yang , Hong Liu , Xiangdong Wang

Spatial Transcriptomics (ST) allows a high-resolution measurement of RNA sequence abundance by systematically connecting cell morphology depicted in Hematoxylin and Eosin (H&E) stained histology images to spatially resolved gene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sichen Zhu , Yuchen Zhu , Molei Tao , Peng Qiu

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiusong Ge , Yingkang Zhan , Wenjie Zhao , Di Zhang , Ke Wang , Jiashuai Liu , Chunze Yang , Chengzu Li , Jian Zhang , Yuxin Dong , Ni Zhang , Qidong Liu , Mireia Crispin-Ortuzar , Huazhu Fu , Chen Li , Zeyu Gao

Spatial transcriptomics (ST) has emerged as an advanced technology that provides spatial context to gene expression. Recently, deep learning-based methods have shown the capability to predict gene expression from WSI data using ST data.…

Machine Learning · Computer Science 2024-12-10 Mingcheng Qu , Yuncong Wu , Donglin Di , Anyang Su , Tonghua Su , Yang Song , Lei Fan

Multiple Instance Learning (MIL) has been widely applied in pathology towards solving critical problems such as automating cancer diagnosis and grading, predicting patient prognosis, and therapy response. Deploying these models in a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Syed Ashar Javed , Dinkar Juyal , Harshith Padigela , Amaro Taylor-Weiner , Limin Yu , Aaditya Prakash

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

Recent advances in computational pathology have leveraged vision-language models to learn joint representations of Hematoxylin and Eosin (HE) images with spatial transcriptomic (ST) profiles. However, existing approaches typically align HE…

Whole Slide Image (WSI) classification has very significant applications in clinical pathology, e.g., tumor identification and cancer diagnosis. Currently, most research attention is focused on Multiple Instance Learning (MIL) using static…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Jiaxiang Gou , Luping Ji , Pei Liu , Mao Ye

Spatial transcriptomics (ST) has revolutionized biomedical research by enabling high resolution gene expression profiling within tissues. However, the high cost and scarcity of high resolution ST data remain significant challenges. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee A. Cooper , Bo Zhou

Recent advances in attention-based multiple instance learning (MIL) have improved our insights into the tissue regions that models rely on to make predictions in digital pathology. However, the interpretability of these approaches is still…

Quantitative Methods · Quantitative Biology 2023-09-11 Willem Bonnaffé , CRUK ICGC Prostate Group , Freddie Hamdy , Yang Hu , Ian Mills , Jens Rittscher , Clare Verrill , Dan J. Woodcock

Melanoma represents a critical health risk due to its aggressive progression and high mortality, underscoring the need for early, interpretable diagnostic tools. While deep learning has advanced in skin lesion classification, most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ciro Listone , Aniello Murano

Accurate prognosis of non-small cell lung cancer (NSCLC) patients undergoing immunotherapy is essential for personalized treatment planning, enabling informed patient decisions, and improving both treatment outcomes and quality of life.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Bingxin Gong , Lian Yang , Junqing Yu , Wei Yang