English
Related papers

Related papers: Fusing Pixels and Genes: Spatially-Aware Learning …

200 papers

Spread through air spaces (STAS) constitutes a novel invasive pattern in lung adenocarcinoma (LUAD), associated with tumor recurrence and diminished survival rates. However, large-scale STAS diagnosis in LUAD remains a labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Liangrui Pan , xiaoyu Li , Guang Zhu , Guanting Li , Ruixin Wang , Jiadi Luo , Yaning Yang , Liang qingchun , Shaoliang Peng

Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL). Spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lihe Liu , Xiaoxi Pan , Yinyin Yuan , Lulu Shang

Spatial transcriptomics (ST) enables the visualization of gene expression within the context of tissue morphology. This emerging discipline has the potential to serve as a foundation for developing tools to design precision medicines.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Shivam Kumar , Samrat Chatterjee

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhiceng Shi , Changmiao Wang , Jun Wan , Wenwen Min

Spatial transcriptomics is a technology that captures gene expression levels at different spatial locations, widely used in tumor microenvironment analysis and molecular profiling of histopathology, providing valuable insights into…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Junzhuo Liu , Markus Eckstein , Zhixiang Wang , Friedrich Feuerhake , Dorit Merhof

Hematoxylin- and eosin (H&E) stained whole-slide images (WSIs) are the foundation of diagnosis of cancer. In recent years, development of deep learning-based methods in computational pathology enabled the prediction of biomarkers directly…

Understanding the intricate cellular environment within biological tissues is crucial for uncovering insights into complex biological functions. While single-cell RNA sequencing has significantly enhanced our understanding of cellular…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Bingjun Li , Mostafa Karami , Masum Shah Junayed , Sheida Nabavi

Recent advances in multi-modal algorithms have driven and been driven by the increasing availability of large image-text datasets, leading to significant strides in various fields, including computational pathology. However, in most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jiawen Chen , Muqing Zhou , Wenrong Wu , Jinwei Zhang , Yun Li , Didong Li

Deep learning-based nuclei segmentation and classification in pathology images typically rely on large-scale pixel-level manual annotations, which are costly and difficult to obtain across diverse tissues and staining conditions. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Kazuya Nishimura , Ryoma Bise , Haruka Hirose , Yasuhiro Kojima

Spatial Transcriptomics is a novel technology that aligns histology images with spatially resolved gene expression profiles. Although groundbreaking, it struggles with gene capture yielding high corruption in acquired data. Given potential…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Gabriel Mejia , Daniela Ruiz , Paula Cárdenas , Leonardo Manrique , Daniela Vega , Pablo Arbeláez

Recent advances in computational pathology have leveraged vision-language models to learn joint representations of Hematoxylin and Eosin (HE) images with spatial transcriptomic (ST) profiles. However, existing approaches typically align HE…

Spatial transcriptomics enables genome-wide expression analysis within native tissue context, yet identifying spatial domains remains challenging due to complex gene-spatial interactions. Existing methods typically process spatial and…

Machine Learning · Computer Science 2025-12-19 Jianping Mei , Siqi Ai , Ye Yuan

Suboptimal generalization of machine learning models on unseen data is a key challenge which hampers the clinical applicability of such models to medical imaging. Although various methods such as domain adaptation and domain generalization…

Image and Video Processing · Electrical Eng. & Systems 2021-08-04 Rikiya Yamashita , Jin Long , Snikitha Banda , Jeanne Shen , Daniel L. Rubin

Spatial transcriptomics is a modern sequencing technology that allows the measurement of the activity of thousands of genes in a tissue sample and map where the activity is occurring. This technology has enabled the study of the so-called…

Methodology · Statistics 2022-09-15 Andrea Sottosanti , Davide Risso

Spatial transcriptomics (ST) has revolutionized biomedical research by enabling high resolution gene expression profiling within tissues. However, the high cost and scarcity of high resolution ST data remain significant challenges. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee A. Cooper , Bo Zhou

Background: Spatial transcriptomics have emerged as a powerful tool in biomedical research because of its ability to capture both the spatial contexts and abundance of the complete RNA transcript profile in organs of interest. However,…

Genomics · Quantitative Biology 2025-04-18 Shuo Shuo Liu , Shikun Wang , Yuxuan Chen , Anil K. Rustgi , Ming Yuan , Jianhua Hu

Masked Image Modeling (MIM) is a promising self-supervised learning approach that enables learning from unlabeled images. Despite its recent success, learning good representations through MIM remains challenging because it requires…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Amir Bar , Florian Bordes , Assaf Shocher , Mahmoud Assran , Pascal Vincent , Nicolas Ballas , Trevor Darrell , Amir Globerson , Yann LeCun

In recent years, the advent of spatial transcriptomics (ST) technology has unlocked unprecedented opportunities for delving into the complexities of gene expression patterns within intricate biological systems. Despite its transformative…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Wenwen Min , Zhiceng Shi , Jun Zhang , Jun Wan , Changmiao Wang

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Spatial Transcriptomics (ST) reveals the spatial distribution of gene expression in tissues, offering critical insights into biological processes and disease mechanisms. However, the high cost, limited coverage, and technical complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yi Niu , Jiashuai Liu , Yingkang Zhan , Jiangbo Shi , Di Zhang , Marika Reinius , Ines Machado , Mireia Crispin-Ortuzar , Jialun Wu , Chen Li , Zeyu Gao