English
Related papers

Related papers: MultiST: A Cross-Attention-Based Multimodal Model …

200 papers

The rapid development of spatial transcriptomics (ST) offers new opportunities to explore the gene expression patterns within the spatial microenvironment. Current research integrates pathological images to infer gene expression, addressing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Junchao Zhu , Ruining Deng , Tianyuan Yao , Juming Xiong , Chongyu Qu , Junlin Guo , Siqi Lu , Yucheng Tang , Daguang Xu , Mengmeng Yin , Yu Wang , Shilin Zhao , Yaohong Wang , Haichun Yang , Yuankai Huo

Accurate detection of cancer tissue regions (CTR) enables deeper analysis of the tumor microenvironment and offers crucial insights into treatment response. Traditional CTR detection methods, which typically rely on the rich cellular…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shuailin Xue , Jun Wan , Lihua Zhang , Wenwen Min

Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spatial transcriptomics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minsoo Lee , Jonghyun Kim , Juseung Yun , Sunwoo Yu , Jongseong Jang

Cancer pathological analysis requires modeling tumor heterogeneity across multiple modalities, primarily through transcriptomics and whole slide imaging (WSI), along with their spatial relations. On one hand, bulk transcriptomics and WSI…

Machine Learning · Computer Science 2026-03-17 Jingkun Yu , Guangkai Shang , Changtao Li , Xun Gong , Tianrui Li , Yazhou He , Zhipeng Luo

Spatial Transcriptomics (ST) provides spatially resolved gene expression profiles within intact tissue architecture, enabling molecular analysis in histological context. However, the high cost, limited throughput, and restricted data…

Machine Learning · Computer Science 2026-03-31 Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee A. Cooper , Bo Zhou

Spatial Transcriptomics (ST) enables the measurement of gene expression while preserving spatial information, offering critical insights into tissue architecture and disease pathology. Recent developments have explored the use of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Hai Dang Nguyen , Nguyen Dang Huy Pham , The Minh Duc Nguyen , Dac Thai Nguyen , Hang Thi Nguyen , Duong M. Nguyen

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Chen Tang , Xinzhu Ma , Encheng Su , Xiufeng Song , Xiaohong Liu , Wei-Hong Li , Lei Bai , Wanli Ouyang , Xiangyu Yue

The rapid advancement of spatial transcriptomics (ST), i.e., spatial gene expressions, has made it possible to measure gene expression within original tissue, enabling us to discover molecular mechanisms. However, current ST platforms…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaofei Wang , Stephen Price , Chao Li

Spatially Resolved Transcriptomics (SRT) is a cutting-edge technique that captures the spatial context of cells within tissues, enabling the study of complex biological networks. Recent graph-based methods leverage both gene expression and…

Machine Learning · Computer Science 2025-06-24 Yunhak Oh , Junseok Lee , Yeongmin Kim , Sangwoo Seo , Namkyeong Lee , Chanyoung Park

An assumption widely used in recent neural style transfer methods is that image styles can be described by global statics of deep features like Gram or covariance matrices. Alternative approaches have represented styles by decomposing them…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Yulun Zhang , Chen Fang , Yilin Wang , Zhaowen Wang , Zhe Lin , Yun Fu , Jimei Yang

Spatial transcriptomics (ST) has revolutionised transcriptomics analysis by preserving tissue architecture, allowing researchers to study gene expression in its native spatial context. However, despite its potential, ST still faces…

Quantitative Methods · Quantitative Biology 2025-05-19 Anthony Baptista , Rosamond Nuamah , Ciro Chiappini , Anita Grigoriadis

While pathology foundation models have transformed cancer image analysis, they often lack integration with molecular data at single-cell resolution, limiting their utility for precision oncology. Here, we present PAST, a pan-cancer…

Quantitative Methods · Quantitative Biology 2025-07-10 Changchun Yang , Haoyang Li , Yushuai Wu , Yilan Zhang , Yifeng Jiao , Yu Zhang , Rihan Huang , Yuan Cheng , Yuan Qi , Xin Guo , Xin Gao

Advances in spatial transcriptomics (ST) technologies enable systematic molecular characterization of tumor microenvironment, tumor gradients and gene regulatory networks. Cancer progression is known to vary along pathological gradients,…

Spatial transcriptomics (ST) is an emerging technology that enables researchers to investigate the molecular relationships underlying tissue morphology. However, acquiring ST data remains prohibitively expensive, and traditional fixed-grid…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Junchao Zhu , Ruining Deng , Junlin Guo , Tianyuan Yao , Chongyu Qu , Juming Xiong , Siqi Lu , Zhengyi Lu , Yanfan Zhu , Marilyn Lionts , Yuechen Yang , Yalin Zheng , Yu Wang , Shilin Zhao , Haichun Yang , Yuankai Huo

Spatial transcriptomics is a modern sequencing technology that allows the measurement of the activity of thousands of genes in a tissue sample and map where the activity is occurring. This technology has enabled the study of the so-called…

Methodology · Statistics 2022-09-15 Andrea Sottosanti , Davide Risso

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Single-cell transcriptomics and proteomics have become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and gene expression at the single-cell…

Genomics · Quantitative Biology 2025-12-15 Hiren Madhu , João Felipe Rocha , Tinglin Huang , Siddharth Viswanath , Smita Krishnaswamy , Rex Ying

In this paper, we introduce QuST-LLM, an innovative extension of QuPath that utilizes the capabilities of large language models (LLMs) to analyze and interpret spatial transcriptomics (ST) data. In addition to simplifying the intricate and…

Genomics · Quantitative Biology 2024-07-03 Chao Hui Huang

The integration of AI in digital pathology, particularly in whole slide image (WSI) and spatial transcriptomics (ST) analysis, holds immense potential for enhancing our understanding of diseases. Despite challenges such as training pattern…

Quantitative Methods · Quantitative Biology 2024-11-18 Chao-Hui Huang , Sara Lichtarge , Diane Fernandez

Forecasting high-resolution land subsidence is a critical yet challenging task due to its complex, non-linear dynamics. While standard architectures like ConvLSTM often fail to model long-range dependencies, we argue that a more fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Wendong Yao , Binhua Huang , Soumyabrata Dev