English
Related papers

Related papers: SToFM: a Multi-scale Foundation Model for Spatial …

200 papers

Spatial transcriptomics (ST) provides essential spatial context by mapping gene expression within tissue, enabling detailed study of cellular heterogeneity and tissue organization. However, aligning ST data with histology images poses…

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng

The integration of spatial multi-omics data from single tissues is crucial for advancing biological research. However, a significant data imbalance impedes progress: while spatial transcriptomics data is relatively abundant, spatial…

Artificial Intelligence · Computer Science 2026-02-06 Zhaorui Jiang , Yingfang Yuan , Lei Hu , Wei Pang

Spatial Transcriptomics (ST) reveals the spatial distribution of gene expression in tissues, offering critical insights into biological processes and disease mechanisms. However, the high cost, limited coverage, and technical complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yi Niu , Jiashuai Liu , Yingkang Zhan , Jiangbo Shi , Di Zhang , Marika Reinius , Ines Machado , Mireia Crispin-Ortuzar , Jialun Wu , Chen Li , Zeyu Gao

While pathology foundation models have transformed cancer image analysis, they often lack integration with molecular data at single-cell resolution, limiting their utility for precision oncology. Here, we present PAST, a pan-cancer…

Quantitative Methods · Quantitative Biology 2025-07-10 Changchun Yang , Haoyang Li , Yushuai Wu , Yilan Zhang , Yifeng Jiao , Yu Zhang , Rihan Huang , Yuan Cheng , Yuan Qi , Xin Guo , Xin Gao

Spatial transcriptomics (ST) profiles gene expression across a tissue section while preserving the spatial coordinates. Because current ST technologies typically profile two-dimensional tissue slices, integrating and aligning slices from…

Quantitative Methods · Quantitative Biology 2026-03-20 Yaqi Wu , Jingfeng Wang , Xin Maizie Zhou , Yanxiang Zhao , Zixuan Cang

The spatial location of cells within tissues and organs is crucial for the manifestation of their specific functions.Spatial transcriptomics technology enables comprehensive measurement of the gene expression patterns in tissues while…

Quantitative Methods · Quantitative Biology 2024-07-12 Shuailin Xue , Fangfang Zhu , Changmiao Wang , Wenwen Min

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

Machine Learning · Computer Science 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

Spatial transcriptomics is a modern sequencing technology that allows the measurement of the activity of thousands of genes in a tissue sample and map where the activity is occurring. This technology has enabled the study of the so-called…

Methodology · Statistics 2022-09-15 Andrea Sottosanti , Davide Risso

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity and offers limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Minghao Han , Dingkang Yang , Linhao Qu , Zizhi Chen , Gang Li , Han Wang , Jiacong Wang , Lihua Zhang

The rapid development of digital pathology and modern deep learning has facilitated the emergence of pathology foundation models that are expected to solve general pathology problems under various disease conditions in one unified model,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yutong Sun , Sichen Zhu , Peng Qiu

Spatial transcriptomics (ST) technologies can be used to align transcriptomes with histopathological morphology, presenting exciting new opportunities for biomolecular discovery. Using ST data, we construct a novel framework, GeneFlow, to…

Quantitative Methods · Quantitative Biology 2025-11-04 Mengbo Wang , Shourya Verma , Aditya Malusare , Luopin Wang , Yiyang Lu , Vaneet Aggarwal , Mario Sola , Ananth Grama , Nadia Atallah Lanman

Foundation models have achieved remarkable success in natural language processing and computer vision, demonstrating strong capabilities in modeling complex patterns. While recent efforts have explored adapting large language models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Changlu Chen , Yanbin Liu , Chaoxi Niu , Ling Chen , Tianqing Zhu

Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Kazuya Nishimura , Ryoma Bise , Yasuhiro Kojima

The development of single-cell and spatial transcriptomics has revolutionized our capacity to investigate cellular properties, functions, and interactions in both cellular and spatial contexts. However, the analysis of single-cell and…

Genomics · Quantitative Biology 2024-12-09 Shuang Ge , Shuqing Sun , Huan Xu , Qiang Cheng , Zhixiang Ren

Human and animal tissues consist of heterogeneous cell types that organize and interact in highly structured manners. Bulk and single-cell sequencing technologies remove cells from their original microenvironments, resulting in a loss of…

Quantitative Methods · Quantitative Biology 2022-02-08 Boxiang Liu , Yanjun Li , Liang Zhang

Large pre-trained models with their numerous model parameters and extensive training datasets have shown excellent performance in various tasks. Many publicly available medical image datasets do not have a sufficient amount of data so there…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Jianhao Xie , Ziang Zhang , Guibo Luo , Yuesheng Zhu

Spatial Transcriptomics (ST) allows a high-resolution measurement of RNA sequence abundance by systematically connecting cell morphology depicted in Hematoxylin and Eosin (H&E) stained histology images to spatially resolved gene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sichen Zhu , Yuchen Zhu , Molei Tao , Peng Qiu

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

The sea surface temperature (SST), a key environmental parameter, is crucial to optimizing production planning, making its accurate prediction a vital research topic. However, the inherent nonlinearity of the marine dynamic system presents…

Machine Learning · Computer Science 2025-04-25 Yin Wang , Chunlin Gong , Xiang Wu , Hanleran Zhang