English
Related papers

Related papers: Multi-modal Spatial Clustering for Spatial Transcr…

200 papers

Spatial transcriptomics is an emerging technology that aligns histopathology images with spatially resolved gene expression profiling. It holds the potential for understanding many diseases but faces significant bottlenecks such as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Gabriel Mejia , Paula Cárdenas , Daniela Ruiz , Angela Castillo , Pablo Arbeláez

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

Deep learning has shown strong potential in cancer classification from whole-slide images (WSIs), but the need for extensive expert annotations often limits its success. Annotation-free approaches, such as multiple instance learning (MIL)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Willmer Rafell Quinones Robles , Sakonporn Noree , Jongwoo Kim , Young Sin Ko , Bryan Wong , Mun Yong Yi

Encoding static images into spike trains is a fundamental step for enabling Spiking Neural Networks (SNNs) to process visual information. However, widely used methods such as rate coding, Poisson encoding, and time-to-first-spike (TTFS)…

Neural and Evolutionary Computing · Computer Science 2026-04-23 Minchi Hu

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Contrastive language--audio pretraining (CLAP) has achieved remarkable success as an audio--text embedding framework, but existing approaches are limited to monaural or single-source conditions and cannot fully capture spatial information.…

Multiple instance learning (MIL) is the dominant framework for whole-slide image analysis in computational pathology, typically combining a frozen patch encoder, a projection layer, and a slide-level aggregator. While encoders and…

Quantitative Methods · Quantitative Biology 2026-05-19 Yucheng Xing , Pei Liu , Jingying Ma , Ruping Hong , Jiangdong Qiu , Tianyu Liu , Kai He , Ling Huang , Mengling Feng

The segmentation of medical images is a fundamental step in automated clinical decision support systems. Existing medical image segmentation methods based on supervised deep learning, however, remain problematic because of their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Euijoon Ahn , Dagan Feng , Jinman Kim

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

Although efficient extraction of discriminative spatial-spectral features is critical for hyperspectral images classification (HSIC), it is difficult to achieve these features due to factors such as the spatial-spectral heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Yimin Zhu , Linlin Xu

With growing emphasis on personalized cancer-therapies,radiogenomics has shown promise in identifying target tumor mutational status on routine imaging (i.e. MRI) scans. These approaches fall into 2 categories: (1) deep-learning/radiomics…

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

Machine Learning · Computer Science 2019-01-07 Duo Xu

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Recent advances in multi-modal AI have demonstrated promising potential for generating the currently expensive spatial transcriptomics (ST) data directly from routine histology images, offering a means to reduce the high cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Junchao Zhu , Ruining Deng , Junlin Guo , Tianyuan Yao , Juming Xiong , Chongyu Qu , Mengmeng Yin , Yu Wang , Shilin Zhao , Haichun Yang , Daguang Xu , Yucheng Tang , Yuankai Huo

The spectacular response observed in clinical trials of immunotherapy in patients with previously uncurable Melanoma, a highly aggressive form of skin cancer, calls for a better understanding of the cancer-immune interface. Computational…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Konstantinos Zormpas-Petridis , Henrik Failmezger , Ioannis Roxanis , Matthew Blackledge , Yann Jamin , Yinyin Yuan

Spatial transcriptomics (ST) enables spot-level in situ expression profiling, but its high cost and limited throughput motivate predicting expression directly from HE-stained histology. Recent advances explore using score- or flow-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Donghai Fang , Yongheng Li , Zhen Wang , Yuansong Zeng , Wenwen Min

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

Identifying spatially contiguous clusters and repeated spatial patterns (RSP) characterized by similar underlying distributions that are spatially apart is a key challenge in modern spatial statistics. Existing constrained clustering…

Methodology · Statistics 2026-04-23 Rajitha Senanayake , Pratheepa Jeganathan

Integrating histopathology with spatial transcriptomics (ST) provides a powerful opportunity to link tissue morphology with molecular function. Yet most existing multimodal approaches rely on a small set of highly variable genes, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sejuti Majumder , Saarthak Kapse , Moinak Bhattacharya , Xuan Xu , Alisa Yurovsky , Prateek Prasanna