English
Related papers

Related papers: DELST: Dual Entailment Learning for Hyperbolic Ima…

200 papers

Single-cell transcriptomics and proteomics have become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and gene expression at the single-cell…

Genomics · Quantitative Biology 2025-12-15 Hiren Madhu , João Felipe Rocha , Tinglin Huang , Siddharth Viswanath , Smita Krishnaswamy , Rex Ying

Recent advances in computational pathology have leveraged vision-language models to learn joint representations of Hematoxylin and Eosin (HE) images with spatial transcriptomic (ST) profiles. However, existing approaches typically align HE…

Recent advances in multi-modal AI have demonstrated promising potential for generating the currently expensive spatial transcriptomics (ST) data directly from routine histology images, offering a means to reduce the high cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Junchao Zhu , Ruining Deng , Junlin Guo , Tianyuan Yao , Juming Xiong , Chongyu Qu , Mengmeng Yin , Yu Wang , Shilin Zhao , Haichun Yang , Daguang Xu , Yucheng Tang , Yuankai Huo

Image-text representation learning forms a cornerstone in vision-language models, where pairs of images and textual descriptions are contrastively aligned in a shared embedding space. Since visual and textual concepts are naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Avik Pal , Max van Spengler , Guido Maria D'Amely di Melendugno , Alessandro Flaborea , Fabio Galasso , Pascal Mettes

In light of the inherent entailment relations between images and text, hyperbolic point vector embeddings, leveraging the hierarchical modeling advantages of hyperbolic space, have been utilized for visual semantic representation learning.…

Artificial Intelligence · Computer Science 2024-08-21 Zhi Qiao , Linbin Han , Xiantong Zhen , Jia-Hong Gao , Zhen Qian

Hyperspectral image (HSI) denoising is a crucial preprocessing procedure for the subsequent HSI applications. Unfortunately, though witnessing the development of deep learning in HSI denoising area, existing convolution-based methods face…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Miaoyu Li , Ying Fu , Yulun Zhang

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhiceng Shi , Changmiao Wang , Jun Wan , Wenwen Min

Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into…

Spatial transcriptomics (ST) enables gene expression mapping within anatomical context but remains costly and low-throughput. Hematoxylin and eosin (H\&E) staining offers rich morphology yet lacks molecular resolution. We present…

Spatial transcriptomics provides an unprecedented perspective for deciphering tissue spatial heterogeneity. However, high-resolution spatial transcriptomic technology remains constrained by limited gene coverage, technical complexity, and…

Biomolecules · Quantitative Biology 2026-05-19 Xinlei Huang , Weihao Dai , Zijun Qin , Xin Yu , Di Wang , Yanran Liu , Lixin Cheng , Xubin Zheng

Tumour heterogeneity in breast cancer poses challenges in predicting outcome and response to therapy. Spatial transcriptomics technologies may address these challenges, as they provide a wealth of information about gene expression at the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Md Mamunur Rahaman , Ewan K. A. Millar , Erik Meijering

Transformer has been widely used for self-supervised pre-training in Natural Language Processing (NLP) and achieved great success. However, it has not been fully explored in visual self-supervised learning. Meanwhile, previous methods only…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhaowen Li , Zhiyang Chen , Fan Yang , Wei Li , Yousong Zhu , Chaoyang Zhao , Rui Deng , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Muhammad Ahmad , Francesco Mauro , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Silvia Liberata Ullo

"Is it possible to predict expression levels of different genes at a given spatial location in the routine histology image of a tumor section by modeling its stain absorption characteristics?" In this work, we propose a "stain-aware"…

Image and Video Processing · Electrical Eng. & Systems 2021-08-27 Muhammad Dawood , Kim Branson , Nasir M. Rajpoot , Fayyaz ul Amir Afsar Minhas

Integrating histopathology with spatial transcriptomics (ST) provides a powerful opportunity to link tissue morphology with molecular function. Yet most existing multimodal approaches rely on a small set of highly variable genes, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sejuti Majumder , Saarthak Kapse , Moinak Bhattacharya , Xuan Xu , Alisa Yurovsky , Prateek Prasanna

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

Spatial transcriptomics (ST) is a novel technology that enables the observation of gene expression at the resolution of individual spots within pathological tissues. ST quantifies the expression of tens of thousands of genes in a tissue…

Machine Learning · Computer Science 2025-11-25 Kaito Shiku , Kazuya Nishimura , Shinnosuke Matsuo , Yasuhiro Kojima , Ryoma Bise

Spatial transcriptomics offers spatially resolved gene expression profiling within tissue sections, but its cost and limited throughput hinder large-scale deployment. To extend this capability to routine practice, recent computational…

Machine Learning · Computer Science 2026-05-07 Keunho Byeon , Jin Tae Kwak

Cellular identity and function are linked to both their intrinsic genomic makeup and extrinsic spatial context within the tissue microenvironment. Spatial transcriptomics (ST) offers an unprecedented opportunity to study this, providing in…

Machine Learning · Computer Science 2026-02-16 Rui Yan , Xiaohan Xing , Xun Wang , Zixia Zhou , Md Tauhidul Islam , Lei Xing

Structuring latent representations in a hierarchical manner enables models to learn patterns at multiple levels of abstraction. However, most prevalent image understanding models focus on visual similarity, and learning visual hierarchies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Ziwei Wang , Sameera Ramasinghe , Chenchen Xu , Julien Monteil , Loris Bazzani , Thalaiyasingam Ajanthan