English
Related papers

Related papers: SPADE: Spatial Transcriptomics and Pathology Align…

200 papers

Spatial transcriptomics (ST) technologies enable gene expression profiling with spatial resolution, offering unprecedented insights into tissue organization and disease heterogeneity. However, current analysis methods often struggle with…

Multi-modal learning adeptly integrates visual and textual data, but its application to histopathology image and text analysis remains challenging, particularly with large, high-resolution images like gigapixel Whole Slide Images (WSIs).…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Quan Liu , Ruining Deng , Can Cui , Tianyuan Yao , Vishwesh Nath , Yucheng Tang , Yuankai Huo

In biological research, fluorescence staining is a key technique to reveal the locations and morphology of subcellular structures. However, it is slow, expensive, and harmful to cells. In this paper, we model it as a deep learning task…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Donghao Zhou , Chunbin Gu , Junde Xu , Furui Liu , Qiong Wang , Guangyong Chen , Pheng-Ann Heng

Spatial transcriptomics (ST) provides crucial insights into tissue micro-environments, but is limited to its high cost and complexity. As an alternative, predicting gene expression from pathology whole slide images (WSI) is gaining…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mingcheng Qu , Yuncong Wu , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Spatial Transcriptomics (ST) reveals the spatial distribution of gene expression in tissues, offering critical insights into biological processes and disease mechanisms. However, the high cost, limited coverage, and technical complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yi Niu , Jiashuai Liu , Yingkang Zhan , Jiangbo Shi , Di Zhang , Marika Reinius , Ines Machado , Mireia Crispin-Ortuzar , Jialun Wu , Chen Li , Zeyu Gao

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with weak labels, which do…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Xinhai Hou , Cheng Jiang , Akhil Kondepudi , Yiwei Lyu , Asadur Chowdury , Honglak Lee , Todd C. Hollon

Spatially-adaptive normalization (SPADE) is remarkably successful recently in conditional semantic image synthesis \cite{park2019semantic}, which modulates the normalized activation with spatially-varying transformations learned from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Zhentao Tan , Dongdong Chen , Qi Chu , Menglei Chai , Jing Liao , Mingming He , Lu Yuan , Gang Hua , Nenghai Yu

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Spatial transcriptomics (ST) technologies can be used to align transcriptomes with histopathological morphology, presenting exciting new opportunities for biomolecular discovery. Using ST data, we construct a novel framework, GeneFlow, to…

Quantitative Methods · Quantitative Biology 2025-11-04 Mengbo Wang , Shourya Verma , Aditya Malusare , Luopin Wang , Yiyang Lu , Vaneet Aggarwal , Mario Sola , Ananth Grama , Nadia Atallah Lanman

Deep learning has shown strong potential in cancer classification from whole-slide images (WSIs), but the need for extensive expert annotations often limits its success. Annotation-free approaches, such as multiple instance learning (MIL)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Willmer Rafell Quinones Robles , Sakonporn Noree , Jongwoo Kim , Young Sin Ko , Bryan Wong , Mun Yong Yi

Spatial Transcriptomics (ST) is a technology that measures gene expression profiles within tissue sections while retaining spatial context. It reveals localized gene expression patterns and tissue heterogeneity, both of which are essential…

Quantitative Methods · Quantitative Biology 2026-03-24 Wei Zhang , Jiajun Chu , Xinci Liu , Chen Tong , Xinyue Li

Multiple instance learning is an ideal mode of analysis for histopathology data, where vast whole slide images are typically annotated with a single global label. In such cases, a whole slide image is modelled as a collection of tissue…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Leo Fillioux , Joseph Boyd , Maria Vakalopoulou , Paul-Henry Cournède , Stergios Christodoulidis

Accurate detection of cancer tissue regions (CTR) enables deeper analysis of the tumor microenvironment and offers crucial insights into treatment response. Traditional CTR detection methods, which typically rely on the rich cellular…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shuailin Xue , Jun Wan , Lihua Zhang , Wenwen Min

Recent advancements in multimodal pre-training models have significantly advanced computational pathology. However, current approaches predominantly rely on visual-language models, which may impose limitations from a molecular perspective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Minghao Han , Dingkang Yang , Jiabei Cheng , Xukun Zhang , Linhao Qu , Zizhi Chen , Lihua Zhang

Digital pathology and the integration of artificial intelligence (AI) models have revolutionized histopathology, opening new opportunities. With the increasing availability of Whole Slide Images (WSIs), there's a growing demand for…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Areej Alsaafin , Peyman Nejat , Abubakr Shafique , Jibran Khan , Saghir Alfasly , Ghazal Alabtah , H. R. Tizhoosh

Self-supervised learning (SSL) has been successful in building patch embeddings of small histology images (e.g., 224x224 pixels), but scaling these models to learn slide embeddings from the entirety of giga-pixel whole-slide images (WSIs)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Guillaume Jaume , Lukas Oldenburg , Anurag Vaidya , Richard J. Chen , Drew F. K. Williamson , Thomas Peeters , Andrew H. Song , Faisal Mahmood

Advancing AI in computational pathology requires large, high-quality, and diverse datasets, yet existing public datasets are often limited in organ diversity, class coverage, or annotation quality. To bridge this gap, we introduce SPIDER…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Dmitry Nechaev , Alexey Pchelnikov , Ekaterina Ivanova

Understanding of spatial attributes is central to effective 3D radiology image analysis where crop-based learning is the de facto standard. Given an image patch, its core spatial properties (e.g., position & orientation) provide helpful…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Nishchal Sapkota , Pengfei Gu , Yaopeng Peng , Hao Zheng , Danny Z. Chen

Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spatial transcriptomics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minsoo Lee , Jonghyun Kim , Juseung Yun , Sunwoo Yu , Jongseong Jang

Spatial Transcriptomics (ST) provides spatially-resolved gene expression, offering crucial insights into tissue architecture and complex diseases. However, its prohibitive cost limits widespread adoption, leading to significant attention on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Taejin Jeong , Joohyeok Kim , Jinyeong Kim , Chanyoung Kim , Seong Jae Hwang