English
Related papers

Related papers: ST-Align: A Multimodal Foundation Model for Image-…

200 papers

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Spatial Transcriptomics (ST) allows a high-resolution measurement of RNA sequence abundance by systematically connecting cell morphology depicted in Hematoxylin and Eosin (H&E) stained histology images to spatially resolved gene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sichen Zhu , Yuchen Zhu , Molei Tao , Peng Qiu

Spatial transcriptomics (ST) has emerged as an advanced technology that provides spatial context to gene expression. Recently, deep learning-based methods have shown the capability to predict gene expression from WSI data using ST data.…

Machine Learning · Computer Science 2024-12-10 Mingcheng Qu , Yuncong Wu , Donglin Di , Anyang Su , Tonghua Su , Yang Song , Lei Fan

Spatial transcriptomics provides an unprecedented perspective for deciphering tissue spatial heterogeneity. However, high-resolution spatial transcriptomic technology remains constrained by limited gene coverage, technical complexity, and…

Biomolecules · Quantitative Biology 2026-05-19 Xinlei Huang , Weihao Dai , Zijun Qin , Xin Yu , Di Wang , Yanran Liu , Lixin Cheng , Xubin Zheng

Radiology Report Generation (RRG) aims to automatically generate diagnostic reports from radiology images. To achieve this, existing methods have leveraged the powerful cross-modal generation capabilities of Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Jiechao Gao , Chang Liu , Yuangang Li

Spatial Transcriptomics (ST) enables the measurement of gene expression while preserving spatial information, offering critical insights into tissue architecture and disease pathology. Recent developments have explored the use of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Hai Dang Nguyen , Nguyen Dang Huy Pham , The Minh Duc Nguyen , Dac Thai Nguyen , Hang Thi Nguyen , Duong M. Nguyen

Spatial variable genes (SVGs) reveal critical information about tissue architecture, cellular interactions, and disease microenvironments. As spatial transcriptomics (ST) technologies proliferate, accurately identifying SVGs across diverse…

Applications · Statistics 2025-10-21 Jiawen Chen , Jinwei Zhang , Dongshen Peng , Yutong Song , Aitong Ruan , Yun Li , Didong Li

Spatial transcriptomics enables simultaneous measurement of gene expression and tissue morphology, offering unprecedented insights into cellular organization and disease mechanisms. However, the field lacks comprehensive benchmarks for…

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

Recent advances in multi-modal AI have demonstrated promising potential for generating the currently expensive spatial transcriptomics (ST) data directly from routine histology images, offering a means to reduce the high cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Junchao Zhu , Ruining Deng , Junlin Guo , Tianyuan Yao , Juming Xiong , Chongyu Qu , Mengmeng Yin , Yu Wang , Shilin Zhao , Haichun Yang , Daguang Xu , Yucheng Tang , Yuankai Huo

Medical vision-language pre-training methods mainly leverage the correspondence between paired medical images and radiological reports. Although multi-view spatial images and temporal sequences of image-report pairs are available in…

Artificial Intelligence · Computer Science 2024-05-31 Jinxia Yang , Bing Su , Wayne Xin Zhao , Ji-Rong Wen

Background: Spatial transcriptomics have emerged as a powerful tool in biomedical research because of its ability to capture both the spatial contexts and abundance of the complete RNA transcript profile in organs of interest. However,…

Genomics · Quantitative Biology 2025-04-18 Shuo Shuo Liu , Shikun Wang , Yuxuan Chen , Anil K. Rustgi , Ming Yuan , Jianhua Hu

The rapid advancement of autonomous systems, including self-driving vehicles and drones, has intensified the need to forge true Spatial Intelligence from multi-modal onboard sensor data. While foundation models excel in single-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Song Wang , Lingdong Kong , Xiaolu Liu , Hao Shi , Wentong Li , Jianke Zhu , Steven C. H. Hoi

Spatial Transcriptomics is a novel technology that aligns histology images with spatially resolved gene expression profiles. Although groundbreaking, it struggles with gene capture yielding high corruption in acquired data. Given potential…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Gabriel Mejia , Daniela Ruiz , Paula Cárdenas , Leonardo Manrique , Daniela Vega , Pablo Arbeláez

While pathology foundation models have transformed cancer image analysis, they often lack integration with molecular data at single-cell resolution, limiting their utility for precision oncology. Here, we present PAST, a pan-cancer…

Quantitative Methods · Quantitative Biology 2025-07-10 Changchun Yang , Haoyang Li , Yushuai Wu , Yilan Zhang , Yifeng Jiao , Yu Zhang , Rihan Huang , Yuan Cheng , Yuan Qi , Xin Guo , Xin Gao

The rapid development of digital pathology and modern deep learning has facilitated the emergence of pathology foundation models that are expected to solve general pathology problems under various disease conditions in one unified model,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yutong Sun , Sichen Zhu , Peng Qiu

Spatial transcriptomics clustering is pivotal for identifying cell subpopulations by leveraging spatial location information. While recent graph-based methods modeling cell-cell interactions have improved clustering accuracy, they remain…

Machine Learning · Computer Science 2026-01-21 Chenkai Guo , Yikai Zhu , Renxiang Guan , Jinli Ma , Siwei Wang , Ke Liang , Guangdun Peng , Dayu Hu

Spatial Transcriptomics (ST) provides spatially resolved gene expression profiles within intact tissue architecture, enabling molecular analysis in histological context. However, the high cost, limited throughput, and restricted data…

Machine Learning · Computer Science 2026-03-31 Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee A. Cooper , Bo Zhou

Representation learning of the task-oriented attention while tracking instrument holds vast potential in image-guided robotic surgery. Incorporating cognitive ability to automate the camera control enables the surgeon to concentrate more on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Mobarakol Islam , Vibashan VS , Chwee Ming Lim , Hongliang Ren

Spatial transcriptomics (ST) is a novel technology that enables the observation of gene expression at the resolution of individual spots within pathological tissues. ST quantifies the expression of tens of thousands of genes in a tissue…

Machine Learning · Computer Science 2025-11-25 Kaito Shiku , Kazuya Nishimura , Shinnosuke Matsuo , Yasuhiro Kojima , Ryoma Bise