English
Related papers

Related papers: Fusing Pixels and Genes: Spatially-Aware Learning …

200 papers

Semi-supervised semantic segmentation in computational pathology remains challenging due to scarce pixel-level annotations and unreliable pseudo-label supervision. We propose UniSemAlign, a dual-modal semantic alignment framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Le-Van Thai , Tien Dat Nguyen , Hoai Nhan Pham , Lan Anh Dinh Thi , Duy-Dong Nguyen , Ngoc Lam Quang Bui

Self-supervised pre-training paradigm has gained increasing prominence for learning transferable representations in medical imaging, yet existing methods for ultrasound (US) images operate at the image or frame level, overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chunzheng Zhu , Yijun Wang , Jianxin Lin , Feng Wang , Hongwei Wang , Lei Zhao , Shengli Li , Kenli Li

Segmentation is a critical task in computational pathology, as it identifies areas affected by disease or abnormal growth and is essential for diagnosis and treatment. However, acquiring high-quality pixel-level supervised segmentation data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zhiling Yan , Sicheng Chen , Tianyi Zhang , Nan Ying , Yanli Lei , Guanglei Zhang

Spatiotemporal learning is challenging due to the intricate interplay between spatial and temporal dependencies, the high dimensionality of the data, and scalability constraints. These challenges are further amplified in scientific domains,…

Machine Learning · Computer Science 2025-04-17 David Keetae Park , Xihaier Luo , Guang Zhao , Seungjun Lee , Miruna Oprescu , Shinjae Yoo

The existing barely-supervised medical image segmentation (BSS) methods, adopting a registration-segmentation paradigm, aim to learn from data with very few annotations to mitigate the extreme label scarcity problem. However, this paradigm…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Junming Su , Zhiqiang Shen , Peng Cao , Jinzhu Yang , Osmar R. Zaiane

Spatial studies of transcriptome provide biologists with gene expression maps of heterogeneous and complex tissues. However, most experimental protocols for spatial transcriptomics suffer from the need to select beforehand a small fraction…

Machine Learning · Computer Science 2019-05-08 Romain Lopez , Achille Nazaret , Maxime Langevin , Jules Samaran , Jeffrey Regier , Michael I. Jordan , Nir Yosef

The rapid development of spatial transcriptomics(ST) enables the measurement of gene expression at spatial resolution, making it possible to simultaneously profile the gene expression, spatial locations of spots, and the matched…

Artificial Intelligence · Computer Science 2024-06-19 Changxi Chi , Hang Shi , Qi Zhu , Daoqiang Zhang , Wei Shao

Intelligent medical diagnosis has shown remarkable progress based on the large-scale datasets with precise annotations. However, fewer labeled images are available due to significantly expensive cost for annotating data by experts. To fully…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Wentao Lei , Lei Liu , Li Liu

While many text-to-audio systems produce monophonic or fixed-stereo outputs, generating audio with user-defined spatial properties remains a challenge. Existing deep learning-based spatialization methods often rely on latent-space…

Sound · Computer Science 2025-09-16 Tutti Chi , Letian Gao , Yixiao Zhang

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

Spatial transcriptomics (ST) technologies have revolutionized the study of gene expression patterns in tissues by providing multimodality data in transcriptomic, spatial, and morphological, offering opportunities for understanding tissue…

Computational Engineering, Finance, and Science · Computer Science 2024-01-17 Zelin Zang , Liangyu Li , Yongjie Xu , Chenrui Duan , Kai Wang , Yang You , Yi Sun , Stan Z. Li

Graph Neural Networks (GNNs) have shown promise in learning dynamic functional connectivity for distinguishing phenotypes from human brain networks. However, obtaining extensive labeled clinical data for training is often…

Machine Learning · Computer Science 2025-05-06 Jungwon Choi , Hyungi Lee , Byung-Hoon Kim , Juho Lee

In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zuan Gao , Yuxin Wang , Yadong Qu , Boqiang Zhang , Zixiao Wang , Jianjun Xu , Hongtao Xie

Foundation models have substantially advanced computational pathology by learning transferable visual representations from large histological datasets, yet their performance varies widely across tasks due to differences in training data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Wenhui Lei , Yusheng Tan , Anqi Li , Hanyu Chen , Hengrui Tian , Ruiying Li , Zhengqun Jiang , Fang Yan , Xiaofan Zhang , Shaoting Zhang

Joint embedding spaces have significantly advanced music understanding and generation by linking text and audio through multimodal contrastive learning. However, these approaches face large memory requirement limitations due to relying on…

Sound · Computer Science 2025-06-24 Julien Guinot , Alain Riou , Elio Quinton , György Fazekas

Single-cell spatial transcriptomics (ST) offers a unique approach to measuring gene expression profiles and spatial cell locations simultaneously. However, most existing ST methods assume that cells in closer spatial proximity exhibit more…

Genomics · Quantitative Biology 2025-06-10 Xiongtao Xiao , Xiaofeng Chen , Feiyan Jiang , Songming Zhang , Wenming Cao , Cheng Tan , Zhangyang Gao , Zhongshan Li

The rapidly emerging field of computational pathology has the potential to enable objective diagnosis, therapeutic response prediction and identification of new morphological features of clinical relevance. However, deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-05-25 Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Richard J. Chen , Matteo Barbieri , Faisal Mahmood

Deep learning has revolutionized medical imaging, but its effectiveness is severely limited by insufficient labeled training data. This paper introduces a novel GAN-based semi-supervised learning framework specifically designed for low…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guido Manni , Clemente Lauretti , Loredana Zollo , Paolo Soda

Medical images are often characterized by their structured anatomical representations and spatially inhomogeneous contrasts. Leveraging anatomical priors in neural networks can greatly enhance their utility in resource-constrained clinical…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Xiang Chen , Min Liu , Rongguang Wang , Renjiu Hu , Dongdong Liu , Gaolei Li , Hang Zhang

Spatial transcriptomics provides an unprecedented perspective for deciphering tissue spatial heterogeneity. However, high-resolution spatial transcriptomic technology remains constrained by limited gene coverage, technical complexity, and…

Biomolecules · Quantitative Biology 2026-05-19 Xinlei Huang , Weihao Dai , Zijun Qin , Xin Yu , Di Wang , Yanran Liu , Lixin Cheng , Xubin Zheng