English
Related papers

Related papers: SToFM: a Multi-scale Foundation Model for Spatial …

200 papers

Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL). Spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lihe Liu , Xiaoxi Pan , Yinyin Yuan , Lulu Shang

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Spatial Transcriptomics (ST) enables the measurement of gene expression while preserving spatial information, offering critical insights into tissue architecture and disease pathology. Recent developments have explored the use of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Hai Dang Nguyen , Nguyen Dang Huy Pham , The Minh Duc Nguyen , Dac Thai Nguyen , Hang Thi Nguyen , Duong M. Nguyen

Spatial transcriptomics enables genome-wide expression analysis within native tissue context, yet identifying spatial domains remains challenging due to complex gene-spatial interactions. Existing methods typically process spatial and…

Machine Learning · Computer Science 2025-12-19 Jianping Mei , Siqi Ai , Ye Yuan

Spatial transcriptomics methods capture cellular measurements such as gene expression and cell types at specific locations in a cell, helping provide a localized picture of tissue health. Traditional visualization techniques superimpose the…

Quantitative Methods · Quantitative Biology 2024-10-16 Siyuan Zhao , G. Elisabeta Marai

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Spatial transcriptomics (ST) enables simultaneous mapping of tissue morphology and spatially resolved gene expression, offering unique opportunities to study tumor microenvironment heterogeneity. Here, we introduce a computational framework…

Quantitative Methods · Quantitative Biology 2026-04-27 Ling Liao , Changhuei Yang , Maxim Artyomov , Mark Watson , Adam Kepecs , Haowen Zhou , Alexey Sergushichev , Richard Cote

Spatial Transcriptomics (ST) is a method that captures gene expression profiles aligned with spatial coordinates. The discrete spatial distribution and the super-high dimensional sequencing results make ST data challenging to be modeled…

Machine Learning · Computer Science 2025-05-08 Qingtian Zhu , Yumin Zheng , Yuling Sang , Yifan Zhan , Ziyan Zhu , Jun Ding , Yinqiang Zheng

Spatially resolved transcriptomics (ST) measures gene expression along with the spatial coordinates of the measurements. The analysis of ST data involves significant computation complexity. In this work, we propose gene expression…

Genomics · Quantitative Biology 2022-05-24 Zhuoyan Xu , Kris Sankaran

The rapid growth of digital pathology and advances in self-supervised deep learning have enabled the development of foundational models for various pathology tasks across diverse diseases. While multimodal approaches integrating diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Ekaterina Redekop , Mara Pleasure , Zichen Wang , Kimberly Flores , Anthony Sisk , William Speier , Corey W. Arnold

In this paper, we introduce QuST-LLM, an innovative extension of QuPath that utilizes the capabilities of large language models (LLMs) to analyze and interpret spatial transcriptomics (ST) data. In addition to simplifying the intricate and…

Genomics · Quantitative Biology 2024-07-03 Chao Hui Huang

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhiceng Shi , Changmiao Wang , Jun Wan , Wenwen Min

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

High-resolution spatial transcriptomics platforms, such as Xenium, generate single-cell images that capture both molecular and spatial context, but their extremely high dimensionality poses major challenges for representation learning and…

Machine learning models in astrophysics are often limited in scope and cannot adapt to data from new instruments or tasks. We introduce SpectraFM, a Transformer-based foundation model architecture that can be pre-trained on stellar spectra…

Instrumentation and Methods for Astrophysics · Physics 2024-11-08 Nolan Koblischke , Jo Bovy

Spatially resolved transcriptomics represents a significant advancement in single-cell analysis by offering both gene expression data and their corresponding physical locations. However, this high degree of spatial resolution entails a…

Genomics · Quantitative Biology 2024-03-19 Xiaoyu Li , Wenwen Min , Shunfang Wang , Changmiao Wang , Taosheng Xu

Spatial transcriptomics provides a molecularly rich description of tissue organization, enabling unsupervised discovery of tissue niches -- spatially coherent regions of distinct cell-type composition and function that are relevant to both…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Arbel Hizmi , Artemii Bakulin , Shai Bagon , Nir Yosef

Understanding cellular trajectories via time-resolved single-cell transcriptomics is vital for studying development, regeneration, and disease. A key challenge is inferring continuous trajectories from discrete snapshots. Biological…

Nucleus segmentation is an important analysis task in digital pathology. However, methods for automatic segmentation often struggle with new data from a different distribution, requiring users to manually annotate nuclei and retrain…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Titus Griebel , Anwai Archit , Constantin Pape

Vision Transformer models have shown impressive effectiveness in the surgical video understanding tasks through long-range dependency modeling. However, current methods suffer from prohibitive computational costs due to processing massive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xixi Jiang , Chen Yang , Dong Zhang , Pingcheng Dong , Xin Yang , Kwang-Ting Cheng