English
Related papers

Related papers: Prototype-driven fusion of pathology and spatial t…

200 papers

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representations on both sides of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Amaya Gallagher-Syed , Costantino Pitzalis , Myles J. Lewis , Michael R. Barnes , Gregory Slabaugh

Spatial transcriptomics (ST) enables transcriptome-wide profiling while preserving the spatial context of tissues, offering unprecedented opportunities to study tissue organization and cell-cell interactions in situ. Despite recent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Wei Wang , Quoc-Toan Ly , Chong Yu , Jun Bai

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guillaume Jaume , Anurag Vaidya , Richard Chen , Drew Williamson , Paul Liang , Faisal Mahmood

Spatial transcriptomics (ST) provides spatially resolved measurements of gene expression, enabling characterization of the molecular landscape of human tissue beyond histological assessment as well as localized readouts that can be aligned…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Konstantin Hemker , Andrew H. Song , Cristina Almagro-Pérez , Guillaume Jaume , Sophia J. Wagner , Anurag Vaidya , Nikola Simidjievski , Mateja Jamnik , Faisal Mahmood

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

Current multimodal fusion approaches in computational oncology primarily focus on integrating multi-gigapixel histology whole slide images (WSIs) with genomic or transcriptomic data, demonstrating improved survival prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Manahil Raza , Ayesha Azam , Talha Qaiser , Nasir Rajpoot

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

Spatial transcriptomics reveals gene expression patterns within tissue context, enabling precision oncology applications such as treatment response prediction, but its high cost and technical complexity limit clinical adoption. Predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Won June Cho , Hongjun Yoon , Daeky Jeong , Hyeongyeol Lim , Yosep Chong

The rapid growth of digital pathology and advances in self-supervised deep learning have enabled the development of foundational models for various pathology tasks across diverse diseases. While multimodal approaches integrating diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Ekaterina Redekop , Mara Pleasure , Zichen Wang , Kimberly Flores , Anthony Sisk , William Speier , Corey W. Arnold

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity and offers limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Minghao Han , Dingkang Yang , Linhao Qu , Zizhi Chen , Gang Li , Han Wang , Jiacong Wang , Lihua Zhang

Cancer pathological analysis requires modeling tumor heterogeneity across multiple modalities, primarily through transcriptomics and whole slide imaging (WSI), along with their spatial relations. On one hand, bulk transcriptomics and WSI…

Machine Learning · Computer Science 2026-03-17 Jingkun Yu , Guangkai Shang , Changtao Li , Xun Gong , Tianrui Li , Yazhou He , Zhipeng Luo

Spatial Transcriptomics (ST) merges the benefits of pathology images and gene expression, linking molecular profiles with tissue structure to analyze spot-level function comprehensively. Predicting gene expression from histology images is a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chen Zhang , Yilu An , Ying Chen , Hao Li , Xitong Ling , Lihao Liu , Junjun He , Yuxiang Lin , Zihui Wang , Rongshan Yu

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with weak labels, which do…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Xinhai Hou , Cheng Jiang , Akhil Kondepudi , Yiwei Lyu , Asadur Chowdury , Honglak Lee , Todd C. Hollon

Spatial transcriptomics (ST) enables the visualization of gene expression within the context of tissue morphology. This emerging discipline has the potential to serve as a foundation for developing tools to design precision medicines.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Shivam Kumar , Samrat Chatterjee

Spatial transcriptomics (ST) bridges gene expression and tissue morphology but faces clinical adoption barriers due to technical complexity and prohibitive costs. While computational methods predict gene expression from H&E-stained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ziqiao Weng , Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee AD Cooper , Weidong Cai , Bo Zhou

Accurate survival prediction from histopathology whole-slide images (WSIs) remains challenging due to their gigapixel resolution, strong spatial heterogeneity, and complex survival distributions. We introduce a comprehensive computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ardhendu Sekhar , Vasu Soni , Keshav Aske , Shivam Madnoorkar , Pranav Jeevan , Amit Sethi

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang
‹ Prev 1 2 3 10 Next ›