English
Related papers

Related papers: STimage-1K4M: A histopathology image-gene expressi…

200 papers

Here we present a structural similarity index measure (SSIM) guided conditional Generative Adversarial Network (cGAN) that generatively performs image-to-image (i2i) synthesis to generate photo-accurate protein channels in multiplexed…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Jillur Rahman Saurav , Mohammad Sadegh Nasr , Paul Koomey , Michael Robben , Manfred Huber , Jon Weidanz , Bríd Ryan , Eytan Ruppin , Peng Jiang , Jacob M. Luber

Spatial transcriptomics reveals gene expression patterns within tissue context, enabling precision oncology applications such as treatment response prediction, but its high cost and technical complexity limit clinical adoption. Predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Won June Cho , Hongjun Yoon , Daeky Jeong , Hyeongyeol Lim , Yosep Chong

Spatially resolved transcriptomics (SRT) has evolved rapidly through various technologies, enabling scientists to investigate both morphological contexts and gene expression profiling at single-cell resolution in parallel. SRT data are…

Automatic integration of whole slide images (WSIs) and gene expression profiles has demonstrated substantial potential in precision clinical diagnosis and cancer progression studies. However, most existing studies focus on individual gene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Junzhuo Liu , Xuemei Du , Daniel Reisenbuchler , Ye Chen , Markus Eckstein , Christian Matek , Friedrich Feuerhake , Dorit Merhof

"Is it possible to predict expression levels of different genes at a given spatial location in the routine histology image of a tumor section by modeling its stain absorption characteristics?" In this work, we propose a "stain-aware"…

Image and Video Processing · Electrical Eng. & Systems 2021-08-27 Muhammad Dawood , Kim Branson , Nasir M. Rajpoot , Fayyaz ul Amir Afsar Minhas

Emerging research has highlighted that artificial intelligence-based multimodal fusion of digital pathology and transcriptomic features can improve cancer diagnosis (grading/subtyping) and prognosis (survival risk) prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Samiran Dey , Christopher R. S. Banerji , Partha Basuchowdhuri , Sanjoy K. Saha , Deepak Parashar , Tapabrata Chakraborti

The integration of spatial multi-omics data from single tissues is crucial for advancing biological research. However, a significant data imbalance impedes progress: while spatial transcriptomics data is relatively abundant, spatial…

Artificial Intelligence · Computer Science 2026-02-06 Zhaorui Jiang , Yingfang Yuan , Lei Hu , Wei Pang

Accurate detection of cancer tissue regions (CTR) enables deeper analysis of the tumor microenvironment and offers crucial insights into treatment response. Traditional CTR detection methods, which typically rely on the rich cellular…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shuailin Xue , Jun Wan , Lihua Zhang , Wenwen Min

Spatial transcriptomics (ST) is a promising technique that characterizes the spatial gene profiling patterns within the tissue context. Comprehensive ST analysis depends on consecutive slices for 3D spatial insights, whereas the missing…

Image and Video Processing · Electrical Eng. & Systems 2025-05-19 NingFeng Que , Xiaofei Wang , Jingjing Chen , Yixuan Jiang , Chao Li

Recent advancements in spatial transcriptomics technologies allow researchers to simultaneously measure RNA expression levels for hundreds to thousands of genes while preserving spatial information within tissues, providing critical…

Methodology · Statistics 2025-07-31 Catherine Higgins , Jingyi Jessica Li , Michelle Carey

Spatial Transcriptomics (ST) offers spatially resolved gene expression but remains costly. Predicting expression directly from widely available Hematoxylin and Eosin (H&E) stained images presents a cost-effective alternative. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jiarui Ouyang , Yihui Wang , Yihang Gao , Yingxue Xu , Shu Yang , Hao Chen

Spatial transcriptomics has revolutionized tissue analysis by simultaneously mapping gene expression, spatial topography, and histological context across consecutive tissue sections, enabling systematic investigation of spatial…

Applications · Statistics 2025-10-24 Meng Zhou , Shuangge Ma , Mengyun Wu

Spatial transcriptomics is an emerging field that enables the identification of functional regions based on the spatial distribution of gene expression. Integrating this functional information present in transcriptomic data with structural…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Shanaka Liyanaarachchi , Chathurya Wijethunga , Shihab Aaqil Ahamed , Akthas Absar , Ranga Rodrigo

Predicting spatial gene expression from H&E histology offers a scalable and clinically accessible alternative to sequencing, but realizing clinical impact requires models that generalize across cancer types and capture biologically coherent…

Machine Learning · Computer Science 2026-02-10 Susu Hu , Qinghe Zeng , Nithya Bhasker , Jakob Nikolas Kather , Stefanie Speidel

Spatial transcriptomics (ST) technologies enable transcriptome-wide gene expression profiling while preserving spatial resolution, offering unprecedented opportunities to uncover complex spatial structures. Due to the ultra-high…

Applications · Statistics 2026-03-11 Changhu Wang , Qiyun Huang , Zihao Chen , Jin Liu , Ruibin Xi

Large pre-trained models with their numerous model parameters and extensive training datasets have shown excellent performance in various tasks. Many publicly available medical image datasets do not have a sufficient amount of data so there…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Jianhao Xie , Ziang Zhang , Guibo Luo , Yuesheng Zhu

Spatial transcriptomics enables genome-wide expression analysis within native tissue context, yet identifying spatial domains remains challenging due to complex gene-spatial interactions. Existing methods typically process spatial and…

Machine Learning · Computer Science 2025-12-19 Jianping Mei , Siqi Ai , Ye Yuan

Biomedical research increasingly relies on integrating diverse data modalities, including gene expression profiles, medical images, and clinical metadata. While medical images and clinical metadata are routinely collected in clinical…

Artificial Intelligence · Computer Science 2026-01-23 Francesca Pia Panaccione , Carlo Sgaravatti , Pietro Pinoli

Histopathology images; microscopy images of stained tissue biopsies contain fundamental prognostic information that forms the foundation of pathological analysis and diagnostic medicine. However, diagnostics from histopathology images…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Aïcha BenTaieb , Ghassan Hamarneh

Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Kazuya Nishimura , Ryoma Bise , Yasuhiro Kojima