中文
相关论文

相关论文: Merlin: A Computed Tomography Vision-Language Foun…

200 篇论文

Vision-language models trained with contrastive learning on paired medical images and reports show strong zero-shot diagnostic capabilities, yet the effect of training batch composition on learned representations remains unexplored for 3D…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Shivika , Kartik Bose , Pankaj Gupta

While foundation models in radiology are expected to be applied to various clinical tasks, computational cost constraints remain a major challenge when training on 3D-CT volumetric data. In this study, we propose TotalFM, a radiological…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Kohei Yamamoto , Tomohiro Kikuchi

Foundation models trained via vision-language pretraining have demonstrated strong zero-shot capabilities across diverse image domains, yet their application to volumetric medical imaging remains limited. We introduce MedCT-VLM: Medical CT…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Thuraya Alzubaidi , Farhad R. Nezami , Muzammil Behzad

Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visual question answering. Traditional task-specific models often…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Yiming Shi , Shaoshuai Yang , Xun Zhu , Haoyu Wang , Xiangling Fu , Miao Li , Ji Wu

Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. Although a few recent…

图像与视频处理 · 电气工程与系统科学 2024-12-19 Changsun Lee , Sangjoon Park , Cheong-Il Shin , Woo Hee Choi , Hyun Jeong Park , Jeong Eun Lee , Jong Chul Ye

Current vision-language models (VLMs) in medicine are primarily designed for categorical question answering (e.g., "Is this normal or abnormal?") or qualitative descriptive tasks. However, clinical decision-making often relies on…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yongcheng Yao , Yongshuo Zong , Raman Dutt , Yongxin Yang , Sotirios A Tsaftaris , Timothy Hospedales

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

Vision-and-language models (VLMs) have been increasingly explored in the medical domain, particularly following the success of CLIP in general domain. However, unlike the relatively straightforward pairing of 2D images and text, curating…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Ziyang Zhang , Yang Yu , Xulei Yang , Si Yong Yeo

Incidental findings in CT scans, though often benign, can have significant clinical implications and should be reported following established guidelines. Traditional manual inspection by radiologists is time-consuming and variable. This…

机器学习 · 计算机科学 2026-04-15 Idan Tankel , Nir Mazor , Rafi Brada , Christina LeBedis , Guy ben-Yosef

Vision-Language Models (VLMs) have shown promise in various 2D visual tasks, yet their readiness for 3D clinical diagnosis remains unclear due to stringent demands for recognition precision, reasoning ability, and domain knowledge. To…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Yixiong Chen , Wenjie Xiao , Pedro R. A. S. Bassi , Xinze Zhou , Sezgin Er , Ibrahim Ethem Hamamci , Zongwei Zhou , Alan Yuille

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

3D medical image analysis is pivotal in numerous clinical applications. However, the scarcity of labeled data and limited generalization capabilities hinder the advancement of AI-empowered models. Radiology reports are easily accessible and…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Xuefeng Ni , Linshan Wu , Jiaxin Zhuang , Qiong Wang , Mingxiang Wu , Varut Vardhanabhuti , Lihai Zhang , Hanyu Gao , Hao Chen

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Modern Vision-Language Models (VLMs) exhibit unprecedented capabilities in cross-modal semantic understanding between visual and textual modalities. Given the intrinsic need for multi-modal integration in clinical applications, VLMs have…

图像与视频处理 · 电气工程与系统科学 2025-06-24 Haoneng Lin , Cheng Xu , Jing Qin

Artificial intelligence (AI) shows great potential in assisting radiologists to improve the efficiency and accuracy of medical image interpretation and diagnosis. However, a versatile AI model requires large-scale data and comprehensive…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Zhongyi Shui , Jianpeng Zhang , Weiwei Cao , Sinuo Wang , Ruizhe Guo , Le Lu , Lin Yang , Xianghua Ye , Tingbo Liang , Qi Zhang , Ling Zhang

Innovations in digital intelligence are transforming robotic surgery with more informed decision-making. Real-time awareness of surgical instrument presence and actions (e.g., cutting tissue) is essential for such systems. Yet, despite…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Jiajun Cheng , Xianwu Zhao , Sainan Liu , Xiaofan Yu , Ravi Prakash , Patrick J. Codd , Jonathan Elliott Katz , Shan Lin

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

There is substantial interest in developing artificial intelligence systems to support radiologists across tasks ranging from segmentation to report generation. Existing computed tomography (CT) foundation models have largely focused on…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Rubén Moreno-Aguado , Alba Magallón , Victor Moreno , Yingying Fang , Guang Yang
‹ 上一页 1 2 3 10 下一页 ›