中文
相关论文

相关论文: MINT: Molecularly Informed Training with Spatial T…

200 篇论文

Spatial Transcriptomics (ST) is a method that captures gene expression profiles aligned with spatial coordinates. The discrete spatial distribution and the super-high dimensional sequencing results make ST data challenging to be modeled…

机器学习 · 计算机科学 2025-05-08 Qingtian Zhu , Yumin Zheng , Yuling Sang , Yifan Zhan , Ziyan Zhu , Jun Ding , Yinqiang Zheng

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

Vision Transformers (ViTs) dominate self-supervised learning (SSL). While they have proven highly effective for large-scale pretraining, they are computationally inefficient and scale poorly with image size. Consequently, foundational…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Nedyalko Prisadnikov , Danda Pani Paudel , Yuqian Fu , Luc Van Gool

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Spatial transcriptomics enables simultaneous measurement of gene expression and tissue morphology, offering unprecedented insights into cellular organization and disease mechanisms. However, the field lacks comprehensive benchmarks for…

Masked Image Modeling (MIM) is a technique in self-supervised learning that focuses on acquiring detailed visual representations from unlabeled images by estimating the missing pixels in randomly masked sections. It has proven to be a…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Khanh-Binh Nguyen , Chae Jung Park

The rapid development of digital pathology and modern deep learning has facilitated the emergence of pathology foundation models that are expected to solve general pathology problems under various disease conditions in one unified model,…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Yutong Sun , Sichen Zhu , Peng Qiu

Background: Spatial transcriptomics have emerged as a powerful tool in biomedical research because of its ability to capture both the spatial contexts and abundance of the complete RNA transcript profile in organs of interest. However,…

基因组学 · 定量生物学 2025-04-18 Shuo Shuo Liu , Shikun Wang , Yuxuan Chen , Anil K. Rustgi , Ming Yuan , Jianhua Hu

Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). Existing approaches typically rely on frozen pre-trained models to extract instance features, neglecting the…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Yi Lin , Zhengjie Zhu , Kwang-Ting Cheng , Hao Chen

Spatial transcriptomics is a technology that captures gene expression levels at different spatial locations, widely used in tumor microenvironment analysis and molecular profiling of histopathology, providing valuable insights into…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Junzhuo Liu , Markus Eckstein , Zhixiang Wang , Friedrich Feuerhake , Dorit Merhof

Spatial transcriptomics is an emerging field that enables the identification of functional regions based on the spatial distribution of gene expression. Integrating this functional information present in transcriptomic data with structural…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Shanaka Liyanaarachchi , Chathurya Wijethunga , Shihab Aaqil Ahamed , Akthas Absar , Ranga Rodrigo

Recent advancements in multimodal pre-training models have significantly advanced computational pathology. However, current approaches predominantly rely on visual-language models, which may impose limitations from a molecular perspective…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Minghao Han , Dingkang Yang , Jiabei Cheng , Xukun Zhang , Linhao Qu , Zizhi Chen , Lihua Zhang

The spatial location of cells within tissues and organs is crucial for the manifestation of their specific functions.Spatial transcriptomics technology enables comprehensive measurement of the gene expression patterns in tissues while…

定量方法 · 定量生物学 2024-07-12 Shuailin Xue , Fangfang Zhu , Changmiao Wang , Wenwen Min

The rapid growth of digital pathology and advances in self-supervised deep learning have enabled the development of foundational models for various pathology tasks across diverse diseases. While multimodal approaches integrating diverse…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Ekaterina Redekop , Mara Pleasure , Zichen Wang , Kimberly Flores , Anthony Sisk , William Speier , Corey W. Arnold

Since the development of self-supervised visual representation learning from contrastive learning to masked image modeling (MIM), there is no significant difference in essence, that is, how to design proper pretext tasks for vision…

计算机视觉与模式识别 · 计算机科学 2023-01-31 Kun Yi , Yixiao Ge , Xiaotong Li , Shusheng Yang , Dian Li , Jianping Wu , Ying Shan , Xiaohu Qie

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

Medical image segmentation remains a formidable challenge due to the label scarcity. Pre-training Vision Transformer (ViT) through masked image modeling (MIM) on large-scale unlabeled medical datasets presents a promising solution,…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Fenghe Tang , Qingsong Yao , Wenxin Ma , Chenxu Wu , Zihang Jiang , S. Kevin Zhou

Spatial transcriptomics (ST) provides crucial insights into tissue micro-environments, but is limited to its high cost and complexity. As an alternative, predicting gene expression from pathology whole slide images (WSI) is gaining…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Mingcheng Qu , Yuncong Wu , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Spatial transcriptomics (ST) captures gene expression within distinct regions (i.e., windows) of a tissue slide. Traditional supervised learning frameworks applied to model ST are constrained to predicting expression from slide image…

计算机视觉与模式识别 · 计算机科学 2024-01-29 Yan Yang , Md Zakir Hossain , Xuesong Li , Shafin Rahman , Eric Stone

Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Kazuya Nishimura , Ryoma Bise , Yasuhiro Kojima