English
Related papers

Related papers: SIGMMA: Hierarchical Graph-Based Multi-Scale Multi…

200 papers

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Vision-language models (VLMs) have recently been integrated into multiple instance learning (MIL) frameworks to address the challenge of few-shot, weakly supervised classification of whole slide images (WSIs). A key trend involves…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Bryan Wong , Jong Woo Kim , Huazhu Fu , Mun Yong Yi

Recent advances in Spatial Transcriptomics (ST) pair histology images with spatially resolved gene expression profiles, enabling predictions of gene expression across different tissue locations based on image patches. This opens up new…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Aniruddha Ganguly , Debolina Chatterjee , Wentao Huang , Jie Zhang , Alisa Yurovsky , Travis Steele Johnson , Chao Chen

Due to its superior efficiency in utilizing annotations and addressing gigapixel-sized images, multiple instance learning (MIL) has shown great promise as a framework for whole slide image (WSI) classification in digital pathology…

Quantitative Methods · Quantitative Biology 2023-07-14 Qiehe Sun , Jiawen Li , Jin Xu , Junru Cheng , Tian Guan , Yonghong He

Histopathology, particularly hematoxylin and eosin (H\&E) staining, plays a critical role in diagnosing and characterizing pathological conditions by highlighting tissue morphology. However, H\&E-stained images inherently lack molecular…

Computational Engineering, Finance, and Science · Computer Science 2025-01-28 Qing Wang , Wen-jie Chen , Bo Li , Jing Su , Guangyu Wang , Qianqian Song

Learning medical visual representations from image-report pairs through joint learning has garnered increasing research attention due to its potential to alleviate the data scarcity problem in the medical domain. The primary challenges stem…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jun Wang , Lixing Zhu , Xiaohan Yu , Abhir Bhalerao , Yulan He

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the…

In clinical practice, many diagnosis tasks rely on the identification of cells in histopathology images. While supervised machine learning techniques require labels, providing manual cell annotations is time-consuming due to the large…

Whole Slide Images (WSIs) in histopathology pose a significant challenge for extensive medical image analysis due to their ultra-high resolution, massive scale, and intricate spatial relationships. Although existing Multiple Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiaxuan Lu , Yuhui Lin , Junyan Shi , Fang Yan , Dongzhan Zhou , Yue Gao , Xiaosong Wang

High-resolution spatial transcriptomics platforms, such as Xenium, generate single-cell images that capture both molecular and spatial context, but their extremely high dimensionality poses major challenges for representation learning and…

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

Recent advances in multi-modal algorithms have driven and been driven by the increasing availability of large image-text datasets, leading to significant strides in various fields, including computational pathology. However, in most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jiawen Chen , Muqing Zhou , Wenrong Wu , Jinwei Zhang , Yun Li , Didong Li

Universal, transferable whole-slide image (WSI) representations are central to computational pathology. Incorporating multiple markers (e.g., immunohistochemistry, IHC) alongside H&E enriches H&E-based features with diverse, biologically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yizhi Zhang , Lei Fan , Zhulin Tao , Donglin Di , Yang Song , Sidong Liu , Cong Cong

Tumour heterogeneity in breast cancer poses challenges in predicting outcome and response to therapy. Spatial transcriptomics technologies may address these challenges, as they provide a wealth of information about gene expression at the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Md Mamunur Rahaman , Ewan K. A. Millar , Erik Meijering

Spatial transcriptomics (ST) has emerged as a powerful technology for bridging histology imaging with gene expression profiling. However, its application has been limited by low throughput and the need for specialized experimental…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Tinglin Huang , Tianyu Liu , Mehrtash Babadi , Wengong Jin , Rex Ying

Self-supervised learning based on instance discrimination has shown remarkable progress. In particular, contrastive learning, which regards each image as well as its augmentations as an individual class and tries to distinguish them from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haohang Xu , Xiaopeng Zhang , Hao Li , Lingxi Xie , Hongkai Xiong , Qi Tian

Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Kazuya Nishimura , Ryoma Bise , Yasuhiro Kojima

Spatial transcriptomics is an emerging technology that aligns histopathology images with spatially resolved gene expression profiling. It holds the potential for understanding many diseases but faces significant bottlenecks such as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Gabriel Mejia , Paula Cárdenas , Daniela Ruiz , Angela Castillo , Pablo Arbeláez

Handwritten mathematical expression recognition (HMER) has attracted extensive attention recently. However, current methods cannot explicitly study the interactions between different symbols, which may fail when faced similar symbols. To…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Zhuang Liu , Ye Yuan , Zhilong Ji , Jingfeng Bai , Xiang Bai

Survival prediction is a complex ordinal regression task that aims to predict the survival coefficient ranking among a cohort of patients, typically achieved by analyzing patients' whole slide images. Existing deep learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Minghao Han , Xukun Zhang , Dingkang Yang , Tao Liu , Haopeng Kuang , Jinghui Feng , Lihua Zhang