中文
相关论文

相关论文: MG-3D: Multi-Grained Knowledge-Enhanced 3D Medical…

200 篇论文

While 3D visual self-supervised learning (vSSL) shows promising results in capturing visual representations, it overlooks the clinical knowledge from radiology reports. Meanwhile, 3D medical vision-language pre-training (MedVLP) remains…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Che Liu , Cheng Ouyang , Yinda Chen , Cesar César Quilodrán-Casas , Lei Ma , Jie Fu , Yike Guo , Anand Shah , Wenjia Bai , Rossella Arcucci

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Understanding 3D medical image volumes is critical in the medical field, yet existing 3D medical convolution and transformer-based self-supervised learning (SSL) methods often lack deep semantic comprehension. Recent advancements in…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Qiuhui Chen , Xuancheng Yao , Huping Ye , Yi Hong

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Vision-and-language models (VLMs) have been increasingly explored in the medical domain, particularly following the success of CLIP in general domain. However, unlike the relatively straightforward pairing of 2D images and text, curating…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Ziyang Zhang , Yang Yu , Xulei Yang , Si Yong Yeo

Medical vision-and-language pre-training (Med-VLP) has received considerable attention owing to its applicability to extracting generic vision-and-language representations from medical images and texts. Most existing methods mainly contain…

计算与语言 · 计算机科学 2022-09-16 Zhihong Chen , Guanbin Li , Xiang Wan

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

Vision-language models (VLMs) show strong potential for complex diagnostic tasks in medical imaging. However, applying VLMs to multi-organ medical imaging introduces two principal challenges: (1) modality-specific vision-language alignment…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Haowen Zhu , Ning Yin , Xiaogen Zhou

Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. Although a few recent…

图像与视频处理 · 电气工程与系统科学 2024-12-19 Changsun Lee , Sangjoon Park , Cheong-Il Shin , Woo Hee Choi , Hyun Jeong Park , Jeong Eun Lee , Jong Chul Ye

Understanding 3D medical image volumes is a critical task in the medical domain. However, existing 3D convolution and transformer-based methods have limited semantic understanding of an image volume and also need a large set of volumes for…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Qiuhui Chen , Huping Ye , Yi Hong

3D medical image analysis is essential for modern healthcare, yet traditional task-specific models are inadequate due to limited generalizability across diverse clinical scenarios. Multimodal large language models (MLLMs) offer a promising…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Yiming Shi , Xun Zhu , Kaiwen Wang , Ying Hu , Chenyi Guo , Miao Li , Ji Wu

In recent years, the growing demand for medical imaging diagnosis has placed a significant burden on radiologists. As a solution, Medical Vision-Language Pre-training (Med-VLP) methods have been proposed to learn universal representations…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Ke Zhang , Yan Yang , Jun Yu , Hanliang Jiang , Jianping Fan , Qingming Huang , Weidong Han

Recently, medical vision-language pre-training (VLP) has reached substantial progress to learn global visual representation from medical images and their paired radiology reports. However, medical imaging tasks in real world usually require…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Che Liu , Cheng Ouyang , Sibo Cheng , Anand Shah , Wenjia Bai , Rossella Arcucci

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

Vision-Language Pre-training (VLP) has shown the merits of analysing medical images, by leveraging the semantic congruence between medical images and their corresponding reports. It efficiently learns visual representations, which in turn…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Xiaoxuan He , Yifan Yang , Xinyang Jiang , Xufang Luo , Haoji Hu , Siyun Zhao , Dongsheng Li , Yuqing Yang , Lili Qiu

Medical Vision Language Pretraining (VLP) has recently emerged as a promising solution to the scarcity of labeled data in the medical domain. By leveraging paired/unpaired vision and text datasets through self-supervised learning, models…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Prashant Shrestha , Sanskar Amgain , Bidur Khanal , Cristian A. Linte , Binod Bhattarai

3D Vision-Language Pre-training (3D-VLP) aims to provide a pre-train model which can bridge 3D scenes with natural language, which is an important technique for embodied intelligence. However, current 3D-VLP datasets are hindered by limited…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Dejie Yang , Zhu Xu , Wentao Mo , Qingchao Chen , Siyuan Huang , Yang Liu

Medical foundation models have the potential to revolutionize healthcare by providing robust and generalized representations of medical data. Medical vision-language pre-training has emerged as a promising approach for learning…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Qiao Deng , Zhongzhen Huang , Yunqi Wang , Zhichuan Wang , Zhao Wang , Xiaofan Zhang , Qi Dou , Yeung Yu Hui , Edward S. Hui

The development of 3D medical vision-language models holds significant potential for disease diagnosis and patient treatment. However, compared to 2D medical images, 3D medical images, such as CT scans, face challenges related to limited…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Haoran Lai , Zihang Jiang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Weifu Lv , S. Kevin Zhou
‹ 上一页 1 2 3 10 下一页 ›