English
Related papers

Related papers: Argus: Benchmarking and Enhancing Vision-Language …

200 papers

Despite significant advancements in adapting Large Language Models (LLMs) for radiology report generation (RRG), clinical adoption remains challenging due to difficulties in accurately mapping pathological and anatomical features to their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Youjia Zhang , Na Feng , Junqing Yu , Wei Yang

Recent advances in AI combine large language models (LLMs) with vision encoders that bring forward unprecedented technical capabilities to leverage for a wide range of healthcare applications. Focusing on the domain of radiology,…

Medical large vision-language Models (Med-LVLMs) have shown promise in clinical applications but suffer from factual inaccuracies and unreliable outputs, posing risks in real-world diagnostics. While RAG has emerged as a potential solution,…

Computation and Language · Computer Science 2026-05-05 Zhe Chen , Yusheng Liao , Zhiyuan Zhu , Haolin Li , Hongcheng Liu , Yanfeng Wang , Yu Wang

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Iryna Hartsock , Ghulam Rasool

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in general domains,…

Clinicians spend a significant amount of time reviewing medical images and transcribing their findings regarding patient diagnosis, referral and treatment in text form. Vision-language models (VLMs), which automatically interpret images and…

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across diverse tasks. Despite great success, recent studies show that LVLMs encounter substantial limitations when engaging with visual graphs. To study the…

Computation and Language · Computer Science 2025-06-09 Yingjie Zhu , Xuefeng Bai , Kehai Chen , Yang Xiang , Jun Yu , Min Zhang

With the availability of large-scale, comprehensive, and general-purpose vision-language (VL) datasets such as MSCOCO, vision-language pre-training (VLP) has become an active area of research and proven to be effective for various VL tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Li Xu , Bo Liu , Ameer Hamza Khan , Lu Fan , Xiao-Ming Wu

Recent advancements in Vision Language Models (VLMs) have demonstrated remarkable promise in generating visually grounded responses. However, their application in the medical domain is hindered by unique challenges. For instance, most VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Lingxiao Luo , Bingda Tang , Xuanzhong Chen , Rong Han , Ting Chen

We propose the VLR-Bench, a visual question answering (VQA) benchmark for evaluating vision language models (VLMs) based on retrieval augmented generation (RAG). Unlike existing evaluation datasets for external knowledge-based VQA, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Hyeonseok Lim , Dongjae Shin , Seohyun Song , Inho Won , Minjun Kim , Junghun Yuk , Haneol Jang , KyungTae Lim

Evaluating generated radiology reports is crucial for the development of radiology AI, but existing metrics fail to reflect the task's clinical requirements. This study proposes a novel evaluation framework using large language models…

Computation and Language · Computer Science 2024-04-02 Zilong Wang , Xufang Luo , Xinyang Jiang , Dongsheng Li , Lili Qiu

Recently, the remarkable success of ChatGPT has sparked a renewed wave of interest in artificial intelligence (AI), and the advancements in visual language models (VLMs) have pushed this enthusiasm to new heights. Differring from previous…

Artificial Intelligence · Computer Science 2025-01-03 Lijie Tao , Haokui Zhang , Haizhao Jing , Yu Liu , Dawei Yan , Guoting Wei , Xizhe Xue

We present a transparent, reproducible measurement of research trends across 26,104 accepted papers from CVPR, ICLR, and NeurIPS spanning 2023-2025. Titles and abstracts are normalized, phrase-protected, and matched against a hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Fengming Lin

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

Multiagent Systems · Computer Science 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

General-purpose vision-language models (VLMs) have emerged as promising tools in radiology, offering zero-shot capabilities that mitigate the need for large labeled datasets. However, in high-stakes domains like diagnostic radiology, these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hao-Chih Lee , Zelong Liu , Hamza Ahmed , Spencer Kim , Sean Huver , Vishwesh Nath , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Vision-language models (VLMs) have shown potential for automated radiology report generation, yet existing approaches rely on global embedding compression of volumetric data, often leading to hallucinated findings and limited anatomical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Giuseppe A. Orlando , Paolo Papotti , Maria A. Zuluaga , Olivier Humbert , Marco Lorenzi

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

Automated radiology report generation from 3D computed tomography (CT) volumes is challenging due to extreme sequence lengths, severe class imbalance, and the tendency of large language models (LLMs) to ignore visual tokens in favor of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 V. K. Cody Bumgardner , Mitchell A. Klusty , Mahmut S. Gokmen , Evan W. Damron

Foundation models trained via vision-language pretraining have demonstrated strong zero-shot capabilities across diverse image domains, yet their application to volumetric medical imaging remains limited. We introduce MedCT-VLM: Medical CT…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Thuraya Alzubaidi , Farhad R. Nezami , Muzammil Behzad