English
Related papers

Related papers: STimage-1K4M: A histopathology image-gene expressi…

200 papers

Spatial transcriptomics methods capture cellular measurements such as gene expression and cell types at specific locations in a cell, helping provide a localized picture of tissue health. Traditional visualization techniques superimpose the…

Quantitative Methods · Quantitative Biology 2024-10-16 Siyuan Zhao , G. Elisabeta Marai

Medical image segmentation requires balancing local precision for boundary-critical clinical applications, global context for anatomical coherence, and computational efficiency for deployment on limited data and hardware a trilemma that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Md. Sanaullah Chowdhury Lameya Sabrin

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Recent advancements in Digital Pathology (DP), particularly through artificial intelligence and Foundation Models, have underscored the importance of large-scale, diverse, and richly annotated datasets. Despite their critical role, publicly…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Dmitry Nechaev , Alexey Pchelnikov , Ekaterina Ivanova

In computational pathology, understanding and generation have evolved along disparate paths: advanced understanding models already exhibit diagnostic-level competence, whereas generative models largely simulate pixels. Progress remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Minghao Han , Yichen Liu , Yizhou Liu , Zizhi Chen , Jingqun Tang , Xuecheng Wu , Dingkang Yang , Lihua Zhang

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

The field of computational pathology presents many challenges for computer vision algorithms due to the sheer size of pathology images. Histopathology images are large and need to be split up into image tiles or patches so modern…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Rob Jewsbury , Abhir Bhalerao , Nasir Rajpoot

Computer Vision has proven to be a powerful tool for analyzing Spatial Transcriptomics (ST) data. However, current models that predict spatially resolved gene expression from histopathology images suffer from significant limitations due to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Paula Cárdenas , Leonardo Manrique , Daniela Vega , Daniela Ruiz , Pablo Arbeláez

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

Quantitative Methods · Quantitative Biology 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

Human and animal tissues consist of heterogeneous cell types that organize and interact in highly structured manners. Bulk and single-cell sequencing technologies remove cells from their original microenvironments, resulting in a loss of…

Quantitative Methods · Quantitative Biology 2022-02-08 Boxiang Liu , Yanjun Li , Liang Zhang

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Spatial transcriptomics (ST) maps gene expression within tissue at individual spots, making it a valuable resource for multimodal representation learning. Additionally, ST inherently contains rich hierarchical information both across and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xulin Chen , Junzhou Huang

Multi-image hiding, which embeds multiple secret images into a cover image and is able to recover these images with high quality, has gradually become a research hotspot in the field of image steganography. However, due to the need to embed…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Weina Dong , Jia Liu , Lifeng Chen , Wenquan Sun , Xiaozhong Pan , Yan Ke

Histopathology slides are routinely marked by pathologists using permanent ink markers that should not be removed as they form part of the medical record. Often tumour regions are marked up for the purpose of highlighting features or other…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Sharib Ali , Nasullah Khalid Alham , Clare Verrill , Jens Rittscher

Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL). Spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lihe Liu , Xiaoxi Pan , Yinyin Yuan , Lulu Shang

Motivation: In recent years, image-based biological assays have steadily become high-throughput, sparking a need for fast automated methods to extract biologically-meaningful information from hundreds of thousands of images. Taking…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Stanley Bryan Z. Hua , Alex X. Lu , Alan M. Moses

The rapid development of spatial transcriptomics (ST) technologies is revolutionizing our understanding of the spatial organization of biological tissues. Current ST methods, categorized into next-generation sequencing-based (seq-based) and…

Machine Learning · Computer Science 2024-07-19 Xiaoyu Li , Fangfang Zhu , Wenwen Min

Scanning transmission X-ray microscopy (STXM) is a nanoscale imaging technique that can utilize several powerful contrast mechanisms for the quantitative mapping of chemical and physical materials properties. Spatial resolutions down to…

Instrumentation and Detectors · Physics 2026-05-27 Simone Finizio , Benjamin Watts , Benedikt Rösner , Tim A. Butcher , Sebastian Wintz , Markus Weigand , Jörg Raabe

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

This study investigates the foundational characteristics of image-to-image translation networks, specifically examining their suitability and transferability within the context of routine clinical environments, despite achieving high levels…

Image and Video Processing · Electrical Eng. & Systems 2024-07-29 Mohammad R. Salmanpour , Amin Mousavi , Yixi Xu , William B Weeks , Ilker Hacihaliloglu