中文
相关论文

相关论文: MIRROR: Multi-Modal Pathological Self-Supervised R…

200 篇论文

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Multiple instance learning (MIL) is the dominant framework for whole-slide image analysis in computational pathology, typically combining a frozen patch encoder, a projection layer, and a slide-level aggregator. While encoders and…

定量方法 · 定量生物学 2026-05-19 Yucheng Xing , Pei Liu , Jingying Ma , Ruping Hong , Jiangdong Qiu , Tianyu Liu , Kai He , Ling Huang , Mengling Feng

Cancer survival prediction using multi-modal medical imaging presents a critical challenge in oncology, mainly due to the vulnerability of deep learning models to noise and protocol variations across imaging centers. Current approaches…

图像与视频处理 · 电气工程与系统科学 2025-05-06 Aiman Farooq , Azad Singh , Deepak Mishra , Santanu Chaudhury

Self-supervised learning is crucial for clinical imaging applications, given the lack of explicit labels in healthcare. However, conventional approaches that rely on precise vision-language alignment are not always feasible in complex…

Segmenting tumors in histological images is vital for cancer diagnosis. While fully supervised models excel with pixel-level annotations, creating such annotations is labor-intensive and costly. Accurate histopathology image segmentation…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Yinsheng He , Xingyu Li , Roger J. Zemp

Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Yupei Zhang , Yating Huang , Wanming Hu , Lequan Yu , Hujun Yin , Chao Li

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

图像与视频处理 · 电气工程与系统科学 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

定量方法 · 定量生物学 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

Multiple instance learning (MIL) is a powerful tool to solve the weakly supervised classification in whole slide image (WSI) based pathology diagnosis. However, the current MIL methods are usually based on independent and identical…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Zhuchen Shao , Hao Bian , Yang Chen , Yifeng Wang , Jian Zhang , Xiangyang Ji , Yongbing Zhang

Multimodal learning, integrating histology images and genomics, promises to enhance precision oncology with comprehensive views at microscopic and molecular levels. However, existing methods may not sufficiently model the shared or…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Huahui Yi , Xiaofei Wang , Kang Li , Chao Li

With the long-term rapid increase in incidences of colorectal cancer (CRC), there is an urgent clinical need to improve risk stratification. The conventional pathology report is usually limited to only a few histopathological features.…

图像与视频处理 · 电气工程与系统科学 2020-07-08 Christian Abbet , Inti Zlobec , Behzad Bozorgtabar , Jean-Philippe Thiran

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Jiaqi Yang , Wenting Chen , Xiaohan Xing , Sean He , Xiaoling Luo , Xinheng Lyu , Linlin Shen , Guoping Qiu

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Multimodal magnetic resonance imaging (MRI) provides complementary information for sub-region analysis of brain tumors. Plenty of methods have been proposed for automatic brain tumor segmentation using four common MRI modalities and…

图像与视频处理 · 电气工程与系统科学 2023-03-10 Hong Liu , Dong Wei , Donghuan Lu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

Recent advancements in multimodal pre-training models have significantly advanced computational pathology. However, current approaches predominantly rely on visual-language models, which may impose limitations from a molecular perspective…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Minghao Han , Dingkang Yang , Jiabei Cheng , Xukun Zhang , Linhao Qu , Zizhi Chen , Lihua Zhang

Thyroid cancer is the most common endocrine malignancy, and accurately distinguishing between benign and malignant thyroid tumors is crucial for developing effective treatment plans in clinical practice. Pathologically, thyroid tumors pose…

图像与视频处理 · 电气工程与系统科学 2024-01-04 Jia Dong , Yao Yao , Yang Dong , Hui Ma

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

人工智能 · 计算机科学 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Cancers are characterized by remarkable heterogeneity and diverse prognosis. Accurate cancer classification is essential for patient stratification and clinical decision-making. Although digital pathology has been advancing cancer diagnosis…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Xiaofei Wang , Hanyu Liu , Yupei Zhang , Boyang Zhao , Hao Duan , Wanming Hu , Yonggao Mou , Stephen Price , Chao Li

We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature…

图像与视频处理 · 电气工程与系统科学 2019-10-22 Reuben Dorent , Samuel Joutard , Marc Modat , Sébastien Ourselin , Tom Vercauteren