English
Related papers

Related papers: Prototype-driven fusion of pathology and spatial t…

200 papers

Spatial omics (SO) technologies enable spatially resolved molecular profiling, while hematoxylin and eosin (H&E) imaging remains the gold standard for morphological assessment in clinical pathology. Recent computational advances…

Deep learning based automated pathological diagnosis has markedly improved diagnostic efficiency and reduced variability between observers, yet its clinical adoption remains limited by opaque model decisions and a lack of traceable…

Cellular identity and function are linked to both their intrinsic genomic makeup and extrinsic spatial context within the tissue microenvironment. Spatial transcriptomics (ST) offers an unprecedented opportunity to study this, providing in…

Machine Learning · Computer Science 2026-02-16 Rui Yan , Xiaohan Xing , Xun Wang , Zixia Zhou , Md Tauhidul Islam , Lei Xing

Histopathological analysis has been transformed by serial section-based methods, advancing beyond traditional 2D histology to enable volumetric and microstructural insights in oncology and inflammatory disease diagnostics. This review…

Tissues and Organs · Quantitative Biology 2025-08-05 Zhenfeng Zhuang , Min Cen , Lei Jiang , Qiong Peng , Yihuang Hu , Hong-Yu Zhou , Liansheng Wang

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Survival analysis, as a challenging task, requires integrating Whole Slide Images (WSIs) and genomic data for comprehensive decision-making. There are two main challenges in this task: significant heterogeneity and complex inter- and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-17 Conghao Xiong , Hao Chen , Hao Zheng , Dong Wei , Yefeng Zheng , Joseph J. Y. Sung , Irwin King

The survival analysis on histological whole-slide images (WSIs) is one of the most important means to estimate patient prognosis. Although many weakly-supervised deep learning models have been developed for gigapixel WSIs, their potential…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Pei Liu , Luping Ji , Feng Ye , Bo Fu

Spatial transcriptomics (ST) measures gene expression at a set of spatial locations in a tissue. Communities of nearby cells that express similar genes form \textit{spatial domains}. Specialized ST clustering algorithms have been developed…

Quantitative Methods · Quantitative Biology 2025-11-12 Perry Beamer , Zixuan Cang

Predicting spatial gene expression from H&E histology offers a scalable and clinically accessible alternative to sequencing, but realizing clinical impact requires models that generalize across cancer types and capture biologically coherent…

Machine Learning · Computer Science 2026-02-10 Susu Hu , Qinghe Zeng , Nithya Bhasker , Jakob Nikolas Kather , Stefanie Speidel

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

Machine Learning · Computer Science 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

Spatial transcriptomics aims to connect high-resolution histology images with spatially resolved gene expression. To achieve better performance on downstream tasks such as gene expression prediction, large-scale pre-training is required to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiahe Qian , Yaoyu Fang , Ziqiao Weng , Xinkun Wang , Lee A. Cooper , Bo Zhou

Spatio-temporal predictive learning is a learning paradigm that enables models to learn spatial and temporal patterns by predicting future frames from given past frames in an unsupervised manner. Despite remarkable progress in recent years,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Cheng Tan , Siyuan Li , Zhangyang Gao , Wenfei Guan , Zedong Wang , Zicheng Liu , Lirong Wu , Stan Z. Li

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Learning meaningful and interpretable representations from high-dimensional volumetric magnetic resonance (MR) images is essential for advancing personalized medicine. While Vision Transformers (ViTs) have shown promise in handling image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qingqiao Hu , Daoan Zhang , Jiebo Luo , Zhenyu Gong , Benedikt Wiestler , Jianguo Zhang , Hongwei Bran Li

Microscopic interpretation of histopathology images underlies many important diagnostic and treatment decisions. While advances in vision-language modeling raise new opportunities for analysis of such images, the gigapixel-scale size of…

Multiple instance learning (MIL) has become the leading approach for extracting discriminative features from whole slide images (WSIs) in computational pathology. Attention-based MIL methods can identify key patches but tend to overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Lubin Gan , Xiaoman Wu , Jing Zhang , Zhifeng Wang , Linhao Qu , Siying Wu , Xiaoyan Sun

Spatial transcriptomics is an emerging field that enables the identification of functional regions based on the spatial distribution of gene expression. Integrating this functional information present in transcriptomic data with structural…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Shanaka Liyanaarachchi , Chathurya Wijethunga , Shihab Aaqil Ahamed , Akthas Absar , Ranga Rodrigo

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu