中文
相关论文

相关论文: Argus: Benchmarking and Enhancing Vision-Language …

200 篇论文

Despite significant advancements in adapting Large Language Models (LLMs) for radiology report generation (RRG), clinical adoption remains challenging due to difficulties in accurately mapping pathological and anatomical features to their…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Qilong Xing , Zikai Song , Youjia Zhang , Na Feng , Junqing Yu , Wei Yang

Recent advances in AI combine large language models (LLMs) with vision encoders that bring forward unprecedented technical capabilities to leverage for a wide range of healthcare applications. Focusing on the domain of radiology,…

Medical large vision-language Models (Med-LVLMs) have shown promise in clinical applications but suffer from factual inaccuracies and unreliable outputs, posing risks in real-world diagnostics. While RAG has emerged as a potential solution,…

计算与语言 · 计算机科学 2026-05-05 Zhe Chen , Yusheng Liao , Zhiyuan Zhu , Haolin Li , Hongcheng Liu , Yanfeng Wang , Yu Wang

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Iryna Hartsock , Ghulam Rasool

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in general domains,…

Clinicians spend a significant amount of time reviewing medical images and transcribing their findings regarding patient diagnosis, referral and treatment in text form. Vision-language models (VLMs), which automatically interpret images and…

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across diverse tasks. Despite great success, recent studies show that LVLMs encounter substantial limitations when engaging with visual graphs. To study the…

计算与语言 · 计算机科学 2025-06-09 Yingjie Zhu , Xuefeng Bai , Kehai Chen , Yang Xiang , Jun Yu , Min Zhang

With the availability of large-scale, comprehensive, and general-purpose vision-language (VL) datasets such as MSCOCO, vision-language pre-training (VLP) has become an active area of research and proven to be effective for various VL tasks…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Li Xu , Bo Liu , Ameer Hamza Khan , Lu Fan , Xiao-Ming Wu

Recent advancements in Vision Language Models (VLMs) have demonstrated remarkable promise in generating visually grounded responses. However, their application in the medical domain is hindered by unique challenges. For instance, most VLMs…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Lingxiao Luo , Bingda Tang , Xuanzhong Chen , Rong Han , Ting Chen

We propose the VLR-Bench, a visual question answering (VQA) benchmark for evaluating vision language models (VLMs) based on retrieval augmented generation (RAG). Unlike existing evaluation datasets for external knowledge-based VQA, the…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Hyeonseok Lim , Dongjae Shin , Seohyun Song , Inho Won , Minjun Kim , Junghun Yuk , Haneol Jang , KyungTae Lim

Evaluating generated radiology reports is crucial for the development of radiology AI, but existing metrics fail to reflect the task's clinical requirements. This study proposes a novel evaluation framework using large language models…

计算与语言 · 计算机科学 2024-04-02 Zilong Wang , Xufang Luo , Xinyang Jiang , Dongsheng Li , Lili Qiu

Recently, the remarkable success of ChatGPT has sparked a renewed wave of interest in artificial intelligence (AI), and the advancements in visual language models (VLMs) have pushed this enthusiasm to new heights. Differring from previous…

人工智能 · 计算机科学 2025-01-03 Lijie Tao , Haokui Zhang , Haizhao Jing , Yu Liu , Dawei Yan , Guoting Wei , Xizhe Xue

We present a transparent, reproducible measurement of research trends across 26,104 accepted papers from CVPR, ICLR, and NeurIPS spanning 2023-2025. Titles and abstracts are normalized, phrase-protected, and matched against a hand-crafted…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Fengming Lin

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

多智能体系统 · 计算机科学 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

General-purpose vision-language models (VLMs) have emerged as promising tools in radiology, offering zero-shot capabilities that mitigate the need for large labeled datasets. However, in high-stakes domains like diagnostic radiology, these…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Hao-Chih Lee , Zelong Liu , Hamza Ahmed , Spencer Kim , Sean Huver , Vishwesh Nath , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Vision-language models (VLMs) have shown potential for automated radiology report generation, yet existing approaches rely on global embedding compression of volumetric data, often leading to hallucinated findings and limited anatomical…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Giuseppe A. Orlando , Paolo Papotti , Maria A. Zuluaga , Olivier Humbert , Marco Lorenzi

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Sonit Singh

Automated radiology report generation from 3D computed tomography (CT) volumes is challenging due to extreme sequence lengths, severe class imbalance, and the tendency of large language models (LLMs) to ignore visual tokens in favor of…

计算机视觉与模式识别 · 计算机科学 2026-03-25 V. K. Cody Bumgardner , Mitchell A. Klusty , Mahmut S. Gokmen , Evan W. Damron

Foundation models trained via vision-language pretraining have demonstrated strong zero-shot capabilities across diverse image domains, yet their application to volumetric medical imaging remains limited. We introduce MedCT-VLM: Medical CT…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Thuraya Alzubaidi , Farhad R. Nezami , Muzammil Behzad