English
Related papers

Related papers: Prototype-driven fusion of pathology and spatial t…

200 papers

Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yupei Zhang , Yating Huang , Wanming Hu , Lequan Yu , Hujun Yin , Chao Li

Whole slide imaging (WSI) has transformed digital pathology by enabling computational analysis of gigapixel histopathology images. Recent foundation model advances have accelerated progress in computational pathology, facilitating joint…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Peihang Wu , Zehong Chen , Lijian Xu

Multimodal machine learning integrating histopathology and molecular data shows promise for cancer prognostication. We systematically reviewed studies combining whole slide images (WSIs) and high-throughput omics to predict overall…

Quantitative Methods · Quantitative Biology 2025-07-30 Charlotte Jennings , Andrew Broad , Lucy Godson , Emily Clarke , David Westhead , Darren Treanor

The histopathological analysis of whole-slide images (WSIs) is fundamental to cancer diagnosis but is a time-consuming and expert-driven process. While deep learning methods show promising results, dominant patch-based methods artificially…

Image and Video Processing · Electrical Eng. & Systems 2025-10-08 Alexander Weers , Alexander H. Berger , Laurin Lux , Peter Schüffler , Daniel Rueckert , Johannes C. Paetzold

Multimodal pathology-genomic analysis is critical for cancer survival prediction. However, existing approaches predominantly integrate formalin-fixed paraffin-embedded (FFPE) slides with genomic data, while neglecting the availability of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Mingcheng Qu , Guang Yang , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Emerging research has highlighted that artificial intelligence-based multimodal fusion of digital pathology and transcriptomic features can improve cancer diagnosis (grading/subtyping) and prognosis (survival risk) prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Samiran Dey , Christopher R. S. Banerji , Partha Basuchowdhuri , Sanjoy K. Saha , Deepak Parashar , Tapabrata Chakraborti

Spatial Transcriptomics (ST) enables the measurement of gene expression while preserving spatial information, offering critical insights into tissue architecture and disease pathology. Recent developments have explored the use of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Hai Dang Nguyen , Nguyen Dang Huy Pham , The Minh Duc Nguyen , Dac Thai Nguyen , Hang Thi Nguyen , Duong M. Nguyen

Spatial Transcriptomics (ST) reveals the spatial distribution of gene expression in tissues, offering critical insights into biological processes and disease mechanisms. However, the high cost, limited coverage, and technical complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yi Niu , Jiashuai Liu , Yingkang Zhan , Jiangbo Shi , Di Zhang , Marika Reinius , Ines Machado , Mireia Crispin-Ortuzar , Jialun Wu , Chen Li , Zeyu Gao

Automatic integration of whole slide images (WSIs) and gene expression profiles has demonstrated substantial potential in precision clinical diagnosis and cancer progression studies. However, most existing studies focus on individual gene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Junzhuo Liu , Xuemei Du , Daniel Reisenbuchler , Ye Chen , Markus Eckstein , Christian Matek , Friedrich Feuerhake , Dorit Merhof

Background: Spatial transcriptomics have emerged as a powerful tool in biomedical research because of its ability to capture both the spatial contexts and abundance of the complete RNA transcript profile in organs of interest. However,…

Genomics · Quantitative Biology 2025-04-18 Shuo Shuo Liu , Shikun Wang , Yuxuan Chen , Anil K. Rustgi , Ming Yuan , Jianhua Hu

Spatial transcriptomics (ST) is a promising technique that characterizes the spatial gene profiling patterns within the tissue context. Comprehensive ST analysis depends on consecutive slices for 3D spatial insights, whereas the missing…

Image and Video Processing · Electrical Eng. & Systems 2025-05-19 NingFeng Que , Xiaofei Wang , Jingjing Chen , Yixuan Jiang , Chao Li

Multiple Instance Learning (MIL) methods have succeeded remarkably in histopathology whole slide image (WSI) analysis. However, most MIL models only offer attention-based explanations that do not faithfully capture the model's decision…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Susu Sun , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Pathological images play an essential role in cancer prognosis, while survival analysis, which integrates computational techniques, can predict critical clinical events such as patient mortality or disease recurrence from whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Guo Tang , Songhan Jiang , Jinpeng Lu , Linghan Cai , Yongbing Zhang

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

Survival prediction, utilizing pathological images and genomic profiles, is increasingly important in cancer analysis and prognosis. Despite significant progress, precise survival analysis still faces two main challenges: (1) The massive…

Image and Video Processing · Electrical Eng. & Systems 2024-06-26 Songhan Jiang , Zhengyu Gan , Linghan Cai , Yifeng Wang , Yongbing Zhang

Deep learning has shown strong potential in cancer classification from whole-slide images (WSIs), but the need for extensive expert annotations often limits its success. Annotation-free approaches, such as multiple instance learning (MIL)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Willmer Rafell Quinones Robles , Sakonporn Noree , Jongwoo Kim , Young Sin Ko , Bryan Wong , Mun Yong Yi

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Microsatellite instability (MSI) is associated with several tumor types and its status has become increasingly vital in guiding patient treatment decisions. However, in clinical practice, distinguishing MSI from its counterpart is…

Machine Learning · Statistics 2020-10-08 Jin Zhu , Wangwei Wu , Yuting Zhang , Shiyun Lin , Yukang Jiang , Ruixian Liu , Xueqin Wang

Spatial transcriptomics (ST) has revolutionised transcriptomics analysis by preserving tissue architecture, allowing researchers to study gene expression in its native spatial context. However, despite its potential, ST still faces…

Quantitative Methods · Quantitative Biology 2025-05-19 Anthony Baptista , Rosamond Nuamah , Ciro Chiappini , Anita Grigoriadis