English
Related papers

Related papers: Prototype-driven fusion of pathology and spatial t…

200 papers

The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jun Shi , Tong Shu , Zhiguo Jiang , Wei Wang , Haibo Wu , Yushan Zheng

Multiple Instance Learning (MIL) is a cornerstone approach in computational pathology (CPath) for generating clinically meaningful slide-level embeddings from gigapixel tissue images. However, MIL often struggles with small, weakly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Daniel Shao , Richard J. Chen , Andrew H. Song , Joel Runevic , Ming Y. Lu , Tong Ding , Faisal Mahmood

Histopathological image analysis is an essential process for the discovery of diseases such as cancer. However, it is challenging to train CNN on whole slide images (WSIs) of gigapixel resolution considering the available memory capacity.…

Image and Video Processing · Electrical Eng. & Systems 2019-10-11 Shusuke Takahama , Yusuke Kurose , Yusuke Mukuta , Hiroyuki Abe , Masashi Fukayama , Akihiko Yoshizawa , Masanobu Kitagawa , Tatsuya Harada

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

In histopathology, intelligent diagnosis of Whole Slide Images (WSIs) is essential for automating and objectifying diagnoses, reducing the workload of pathologists. However, diagnostic models often face the challenge of forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Weixi Zheng , Aoling Huang , Jingping Yuan , Haoyu Zhao , Zhou Zhao , Yongchao Xu , Thierry Géraud

Spatial Transcriptomics (ST) provides spatially resolved gene expression profiles within intact tissue architecture, enabling molecular analysis in histological context. However, the high cost, limited throughput, and restricted data…

Machine Learning · Computer Science 2026-03-31 Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee A. Cooper , Bo Zhou

Whole Slide Image (WSI) analysis plays a crucial role in modern digital pathology, enabling large-scale feature extraction from tissue samples. However, traditional feature extraction pipelines based on tools like CellProfiler often involve…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Yuechen Yang , Yu Wang , Tianyuan Yao , Ruining Deng , Mengmeng Yin , Shilin Zhao , Haichun Yang , Yuankai Huo

Spatial Transcriptomics (ST) technologies provide biologists with rich insights into single-cell biology by preserving spatial context of cells. Building foundational models for ST can significantly enhance the analysis of vast and complex…

Genomics · Quantitative Biology 2025-07-24 Suyuan Zhao , Yizhen Luo , Ganbo Yang , Yan Zhong , Hao Zhou , Zaiqing Nie

Computational pathology foundation models (CPathFMs) have emerged as a powerful approach for analyzing histopathological data, leveraging self-supervised learning to extract robust feature representations from unlabeled whole-slide images.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Ajit J. Nirmal , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Introducing interpretability and reasoning into Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) analysis is challenging, given the complexity of gigapixel slides. Traditionally, MIL interpretability is limited to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Saarthak Kapse , Pushpak Pati , Srijan Das , Jingwei Zhang , Chao Chen , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras , Rajarsi R. Gupta , Prateek Prasanna

Recent developments in spatial omics technologies have enabled the generation of high dimensional molecular data, such as transcriptomes, proteomes, and epigenomes, within their spatial tissue context, either through coprofiling on the same…

Quantitative Methods · Quantitative Biology 2026-01-21 Esra Busra Isik , Yusuf Hakan Usta , Haozhe Liu , Maryam Riazi , William Roach , Hongpeng Zhou , Magnus Rattray , Sokratia Georgaka

Whole Slide Images (WSIs) exhibit hierarchical structure, where diagnostic information emerges from cellular morphology, regional tissue organization, and global context. Existing Computational Pathology (CPath) Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Basit Alawode , Arif Mahmood , Muaz Khalifa Al-Radi , Shahad Albastaki , Asim Khan , Muhammad Bilal , Moshira Ali Abdalla , Mohammed Bennamoun , Sajid Javed

Spatial transcriptomics enables simultaneous measurement of gene expression and tissue morphology, offering unprecedented insights into cellular organization and disease mechanisms. However, the field lacks comprehensive benchmarks for…

Remarkable strides in computational pathology have been made in the task-agnostic foundation model that advances the performance of a wide array of downstream clinical tasks. Despite the promising performance, there are still several…

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Hematoxylin- and eosin (H&E) stained whole-slide images (WSIs) are the foundation of diagnosis of cancer. In recent years, development of deep learning-based methods in computational pathology enabled the prediction of biomarkers directly…

Spatial transcriptomics (ST) is a groundbreaking genomic technology that enables spatial localization analysis of gene expression within tissue sections. However, it is significantly limited by high costs and sparse spatial resolution. An…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Zhiceng Shi , Shuailin Xue , Fangfang Zhu , Wenwen Min

Clinical decision-making in oncology involves multimodal data such as radiology scans, molecular profiling, histopathology slides, and clinical factors. Despite the importance of these modalities individually, no deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Nathaniel Braman , Jacob W. H. Gordon , Emery T. Goossens , Caleb Willis , Martin C. Stumpe , Jagadish Venkataraman

Understanding the spatial architecture of the tumor microenvironment (TME) is critical to advance precision oncology. We present ProteinPNet, a novel framework based on prototypical part networks that discovers TME motifs from spatial…

Machine Learning · Computer Science 2025-12-03 Louis McConnell , Jieran Sun , Theo Maffei , Raphael Gottardo , Marianna Rapsomaniki

Developing self-supervised learning (SSL) models that can learn universal and transferable representations of H&E gigapixel whole-slide images (WSIs) is becoming increasingly valuable in computational pathology. These models hold the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Guillaume Jaume , Anurag Vaidya , Andrew Zhang , Andrew H. Song , Richard J. Chen , Sharifa Sahai , Dandan Mo , Emilio Madrigal , Long Phi Le , Faisal Mahmood