English
Related papers

Related papers: Cross-Modal Knowledge Distillation from Spatial Tr…

200 papers

Cell detection, segmentation and classification are essential for analyzing tumor microenvironments (TME) on hematoxylin and eosin (H&E) slides. Existing methods suffer from poor performance on understudied cell types (rare or not present…

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Due to limitations in data quality, some essential visual tasks are difficult to perform independently. Introducing previously unavailable information to transfer informative dark knowledge has been a common way to solve such hard tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Lingyu Si , Hongwei Dong , Wenwen Qiang , Junzhi Yu , Wenlong Zhai , Changwen Zheng , Fanjiang Xu , Fuchun Sun

In order to understand the complexities of cellular biology, researchers are interested in two important metrics: the genetic expression information of cells and their spatial coordinates within a tissue sample. However, state-of-the art…

Machine Learning · Computer Science 2023-11-02 J. Ding , S. N. Zaman , P. Y. Chen , D. Wang

Transvaginal ultrasound is a critical imaging modality for evaluating cervical anatomy and detecting physiological changes. However, accurate segmentation of cervical structures remains challenging due to low contrast, shadow artifacts, and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Tran Quoc Khanh Le , Nguyen Lan Vi Vu , Ha-Hieu Pham , Xuan-Loc Huynh , Tien-Huy Nguyen , Minh Huu Nhat Le , Quan Nguyen , Hien D. Nguyen

Spatial transcriptomics has the potential to transform our understanding of RNA expression in tissues. Classical array-based technologies produce multiple-cell-scale measurements requiring deconvolution to recover single cell information.…

Medical image analysis faces significant challenges in data sharing due to privacy regulations and complex institutional protocols. Dataset distillation offers a solution to address these challenges by synthesizing compact datasets that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Le Dong , Jinghao Bian , Jingyang Hou , Jingliang Hu , Yilei Shi , Weisheng Dong , Xiao Xiang Zhu , Lichao Mou

Multiple instance learning (MIL) is the dominant framework for whole-slide image analysis in computational pathology, typically combining a frozen patch encoder, a projection layer, and a slide-level aggregator. While encoders and…

Quantitative Methods · Quantitative Biology 2026-05-19 Yucheng Xing , Pei Liu , Jingying Ma , Ruping Hong , Jiangdong Qiu , Tianyu Liu , Kai He , Ling Huang , Mengling Feng

For the Bio+Med-Vis Challenge 2024, we propose a visual analytics system as a redesign for the scatter pie chart visualization of cell type proportions of spatial transcriptomics data. Our design uses three linked views: a view of the…

Human-Computer Interaction · Computer Science 2024-09-12 David Hägele , Yuxuan Tang , Daniel Weiskopf

Knowledge distillation becomes a de facto standard to improve the performance of small neural networks. Most of the previous works propose to regress the representational features from the teacher to the student in a one-to-one spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Sihao Lin , Hongwei Xie , Bing Wang , Kaicheng Yu , Xiaojun Chang , Xiaodan Liang , Gang Wang

Cancer pathological analysis requires modeling tumor heterogeneity across multiple modalities, primarily through transcriptomics and whole slide imaging (WSI), along with their spatial relations. On one hand, bulk transcriptomics and WSI…

Machine Learning · Computer Science 2026-03-17 Jingkun Yu , Guangkai Shang , Changtao Li , Xun Gong , Tianrui Li , Yazhou He , Zhipeng Luo

The rapid advancement of spatial transcriptomics (ST), i.e., spatial gene expressions, has made it possible to measure gene expression within original tissue, enabling us to discover molecular mechanisms. However, current ST platforms…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaofei Wang , Stephen Price , Chao Li

Deep learning methods usually require a large amount of training data and lack interpretability. In this paper, we propose a novel knowledge distillation and model interpretation framework for medical image classification that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Thanh Nguyen-Duc , He Zhao , Jianfei Cai , Dinh Phung

Existing 3D Human Pose Estimation (HPE) methods achieve high accuracy but suffer from computational overhead and slow inference, while knowledge distillation methods fail to address spatial relationships between joints and temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Weihong Chen , Xuemiao Xu , Haoxin Yang , Yi Xie , Peng Xiao , Cheng Xu , Huaidong Zhang , Pheng-Ann Heng

We present a hybrid-view-based knowledge distillation framework, termed HVDistill, to guide the feature learning of a point cloud neural network with a pre-trained image network in an unsupervised manner. By exploiting the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Sha Zhang , Jiajun Deng , Lei Bai , Houqiang Li , Wanli Ouyang , Yanyong Zhang

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

High-resolution spatial transcriptomics platforms, such as Xenium, generate single-cell images that capture both molecular and spatial context, but their extremely high dimensionality poses major challenges for representation learning and…

Spatial omics (SO) technologies enable spatially resolved molecular profiling, while hematoxylin and eosin (H&E) imaging remains the gold standard for morphological assessment in clinical pathology. Recent computational advances…

Vanilla unsupervised domain adaptation methods tend to optimize the model with fixed neural architecture, which is not very practical in real-world scenarios since the target data is usually processed by different resource-limited devices.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Rang Meng , Weijie Chen , Shicai Yang , Jie Song , Luojun Lin , Di Xie , Shiliang Pu , Xinchao Wang , Mingli Song , Yueting Zhuang

Virtual immunohistochemistry (IHC) staining from hematoxylin and eosin (H&E) images can accelerate diagnostics by providing preliminary molecular insight directly from routine sections, reducing the need for repeat sectioning when tissue is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Jillur Rahman Saurav , Thuong Le Hoai Pham , Pritam Mukherjee , Paul Yi , Brent A. Orr , Jacob M. Luber