中文
相关论文

相关论文: Generalist Foundation Models from a Multimodal Dat…

200 篇论文

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…

Medical image analysis is crucial in modern radiological diagnostics, especially given the exponential growth in medical imaging data. The demand for automated report generation systems has become increasingly urgent. While prior research…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Hao Chen , Wei Zhao , Yingli Li , Tianyang Zhong , Yisong Wang , Youlan Shang , Lei Guo , Junwei Han , Tianming Liu , Jun Liu , Tuo Zhang

Spoken communication plays a central role in clinical workflows. In radiology, for example, most reports are created through dictation. Yet, nearly all medical AI systems rely exclusively on written text. In this work, we address this gap…

Developing generalist foundation model has recently attracted tremendous attention among researchers in the field of AI for Medicine (AI4Medicine). A pivotal insight in developing these models is their reliance on dataset scaling, which…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xiaoman Zhang , Chaoyi Wu , Ziheng Zhao , Jiayu Lei , Ya Zhang , Yanfeng Wang , Weidi Xie

Recent 3D CT vision-language models align volumes with reports via contrastive pretraining, but typically rely on limited public data and provide only coarse global supervision. We train a 3D CT vision-language model on 98k report-volume…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Simon Ging , Philipp Arnold , Sebastian Walter , Hani Alnahas , Hannah Bast , Elmar Kotter , Jiancheng Yang , Behzad Bozorgtabar , Thomas Brox

The Vision-Language Foundation model is increasingly investigated in the fields of computer vision and natural language processing, yet its exploration in ophthalmology and broader medical applications remains limited. The challenge is the…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Jiawei Du , Jia Guo , Weihang Zhang , Shengzhu Yang , Hanruo Liu , Huiqi Li , Ningli Wang

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

Generalist foundation model has ushered in newfound capabilities in medical domain. However, the contradiction between the growing demand for high-quality annotated data with patient privacy continues to intensify. The utilization of…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Hao Wei , Bowen Liu , Minqing Zhang , Peilun Shi , Wu Yuan

Artificial intelligence (AI) shows great potential in assisting radiologists to improve the efficiency and accuracy of medical image interpretation and diagnosis. However, a versatile AI model requires large-scale data and comprehensive…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Zhongyi Shui , Jianpeng Zhang , Weiwei Cao , Sinuo Wang , Ruizhe Guo , Le Lu , Lin Yang , Xianghua Ye , Tingbo Liang , Qi Zhang , Ling Zhang

Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation models hold significant promise for addressing these…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Danli Shi , Weiyi Zhang , Jiancheng Yang , Siyu Huang , Xiaolan Chen , Mayinuer Yusufu , Kai Jin , Shan Lin , Shunming Liu , Qing Zhang , Mingguang He

Radiologists highly desire fully automated versatile AI for medical imaging interpretation. However, the lack of extensively annotated large-scale multi-disease datasets has hindered the achievement of this goal. In this paper, we explore…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Weiwei Cao , Jianpeng Zhang , Yingda Xia , Tony C. W. Mok , Zi Li , Xianghua Ye , Le Lu , Jian Zheng , Yuxing Tang , Ling Zhang

Although fusion of information from multiple views of mammograms plays an important role to increase accuracy of breast cancer detection, developing multi-view mammograms-based computer-aided diagnosis (CAD) schemes still faces challenges…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Xuxin Chen , Yuheng Li , Mingzhe Hu , Ella Salari , Xiaoqian Chen , Richard L. J. Qiu , Bin Zheng , Xiaofeng Yang

The integration of artificial intelligence (AI) with radiology marks a transformative era in medicine. Vision foundation models have been adopted to enhance radiologic imaging analysis. However, the distinct complexities of radiologic 2D…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Zhixiu Lu , Hailong Li , Nehal A. Parikh , Jonathan R. Dillman , Lili He

As medical imaging is central to diagnostic processes, automating the generation of radiology reports has become increasingly relevant to assist radiologists with their heavy workloads. Most current methods rely solely on global image…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Hamza Kalisch , Fabian Hörst , Jens Kleesiek , Ken Herrmann , Constantin Seibold

Chest computed tomography (CT) is central to the detection and management of thoracic disease, yet the growing scale and complexity of volumetric imaging increasingly exceed what can be addressed by scan-level prediction alone. Clinically…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Xuguang Bai , Mingxuan Liu , Tongxi Song , Yifei Chen , Hongjia Yang , Kasidit Anmahapong , Zihan Li , Ying Zhou , Qiyuan Tian

Vision-language models have emerged as a powerful tool for previously challenging multi-modal classification problem in the medical domain. This development has led to the exploration of automated image description generation for…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Mansi Kakkar , Dattesh Shanbhag , Chandan Aladahalli , Gurunath Reddy M

Foundation models are becoming increasingly effective in the medical domain, offering pre-trained models on large datasets that can be readily adapted for downstream tasks. Despite progress, fetal ultrasound images remain a challenging…

Foundation models (FMs) have shown transformative potential in radiology by performing diverse, complex tasks across imaging modalities. Here, we developed CT-FM, a large-scale 3D image-based pre-trained model designed explicitly for…

图像与视频处理 · 电气工程与系统科学 2025-02-27 Suraj Pai , Ibrahim Hadzic , Dennis Bontempi , Keno Bressem , Benjamin H. Kann , Andriy Fedorov , Raymond H. Mak , Hugo J. W. L. Aerts

Computed tomography (CT) has been widely explored as a COVID-19 screening and assessment tool to complement RT-PCR testing. To assist radiologists with CT-based COVID-19 screening, a number of computer-aided systems have been proposed.…

图像与视频处理 · 电气工程与系统科学 2022-11-17 Hayden Gunraj , Tia Tuinstra , Alexander Wong

The development of 3D medical vision-language models holds significant potential for disease diagnosis and patient treatment. However, compared to 2D medical images, 3D medical images, such as CT scans, face challenges related to limited…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Haoran Lai , Zihang Jiang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Weifu Lv , S. Kevin Zhou
‹ 上一页 1 2 3 10 下一页 ›