中文
相关论文

相关论文: Self-Supervised Multi-Modal Alignment for Whole Bo…

200 篇论文

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

Image matching, which aims to identify corresponding pixel locations between images, is crucial in a wide range of scientific disciplines, aiding in image registration, fusion, and analysis. In recent years, deep learning-based image…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Xingyi He , Hao Yu , Sida Peng , Dongli Tan , Zehong Shen , Hujun Bao , Xiaowei Zhou

Self-supervised deep learning has accelerated 2D natural image analysis but remains difficult to translate into 3D MRI, where data are scarce and pre-trained 2D backbones cannot capture volumetric context. We present a…

计算机视觉与模式识别 · 计算机科学 2025-07-30 Liam Chalcroft , Jenny Crinion , Cathy J. Price , John Ashburner

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Total-body dual X-ray absorptiometry (TBDXA) imaging is a relatively low-cost whole-body imaging modality, widely used for body composition assessment. We develop and validate a deep learning method for automatic fiducial point placement on…

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

图像与视频处理 · 电气工程与系统科学 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Self-supervised learning (SSL) approaches have achieved great success when the amount of labeled data is limited. Within SSL, models learn robust feature representations by solving pretext tasks. One such pretext task is contrastive…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Jamshid Hassanpour , Vinkle Srivastav , Didier Mutter , Nicolas Padoy

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

图像与视频处理 · 电气工程与系统科学 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu

Supervised deep learning usually faces more challenges in medical images than in natural images. Since annotations in medical images require the expertise of doctors and are more time-consuming and expensive. Thus, some researchers turn to…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Tao Yang , Lisheng Wang

Medical image analysis increasingly relies on the integration of multiple imaging modalities to capture complementary anatomical and functional information, enabling more accurate diagnosis and treatment planning. Achieving aligned feature…

图像与视频处理 · 电气工程与系统科学 2025-09-04 Yunhao Liu , Suyang Xi , Shiqi Liu , Hong Ding , Chicheng Jin , Chong Zhong , Junjun He , Catherine C. Liu , Yiqing Shen

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

图像与视频处理 · 电气工程与系统科学 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

Self-supervised learning methods have witnessed a recent surge of interest after proving successful in multiple application fields. In this work, we leverage these techniques, and we propose 3D versions for five different self-supervised…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Aiham Taleb , Winfried Loetzsch , Noel Danz , Julius Severin , Thomas Gaertner , Benjamin Bergner , Christoph Lippert

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

图像与视频处理 · 电气工程与系统科学 2020-10-08 Yue Yang , Pengtao Xie

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Self-supervised pre-training methods in medical imaging typically treat each individual as an isolated instance, learning representations through augmentation-based objectives or masked reconstruction. They often do not adequately…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Tan Pan , Shuhao Mei , Yixuan Sun , Kaiyu Guo , Chen Jiang , Zhaorui Tan , Mengzhu Li , Limei Han , Xiang Zou , Yuan Cheng , Mahsa Baktashmotlagh

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

机器学习 · 计算机科学 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Zekang Chen , Jia Wei , Rui Li