English
Related papers

Related papers: ReXVQA: A Large-scale Visual Question Answering Be…

200 papers

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Chest X-ray plays a central role in thoracic diagnosis, and its interpretation inherently requires multi-step, evidence-grounded reasoning. However, large vision-language models (LVLMs) often generate plausible responses that are not…

Artificial Intelligence · Computer Science 2026-03-25 Hyungyung Lee , Hangyul Yoon , Edward Choi

Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal…

Recent advances in reasoning-enhanced large language models (LLMs) and multimodal LLMs (MLLMs) have significantly improved performance in complex tasks, yet medical AI models often overlook the structured reasoning processes inherent in…

Artificial Intelligence · Computer Science 2025-05-22 Ziqing Fan , Cheng Liang , Chaoyi Wu , Ya Zhang , Yanfeng Wang , Weidi Xie

We present ReXGradient-160K, representing the largest publicly available chest X-ray dataset to date in terms of the number of patients. This dataset contains 160,000 chest X-ray studies with paired radiological reports from 109,487 unique…

Image and Video Processing · Electrical Eng. & Systems 2025-05-13 Xiaoman Zhang , Julián N. Acosta , Josh Miller , Ouwen Huang , Pranav Rajpurkar

Large scale vision language models have shown promise in automating chest Xray interpretation, yet their clinical utility remains limited by a gap between model outputs and radiologist reasoning. Most systems optimize for semantic…

Artificial Intelligence · Computer Science 2026-04-17 Kinhei Lee , Peiyuan Jing , Zhenxuan Zhang , Yue Yang , Tao Wang , Dominic C Marshall , Yingying Fang , Guang Yang

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Over 1.4 billion chest X-rays (CXRs) are performed annually due to their cost-effectiveness as an initial diagnostic test. This scale of radiological studies provides a significant opportunity to streamline CXR interpretation and…

To contribute to automating the medical vision-language model, we propose a novel Chest-Xray Difference Visual Question Answering (VQA) task. Given a pair of main and reference images, this task attempts to answer several questions on both…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Xinyue Hu , Lin Gu , Qiyuan An , Mengliang Zhang , Liangchen Liu , Kazuma Kobayashi , Tatsuya Harada , Ronald M. Summers , Yingying Zhu

Medical Visual Question Answering (MedVQA) is a promising tool to assist radiologists by automating medical image interpretation through question answering. Despite advances in models and datasets, MedVQA's integration into clinical…

Computation and Language · Computer Science 2025-07-15 Deepali Mishra , Chaklam Silpasuwanchai , Ashutosh Modi , Madhumita Sushil , Sorayouth Chumnanvej

Text-Centric Visual Question Answering (TEC-VQA) in its proper format not only facilitates human-machine interaction in text-centric visual environments but also serves as a de facto gold proxy to evaluate AI models in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Jingqun Tang , Qi Liu , Yongjie Ye , Jinghui Lu , Shu Wei , Chunhui Lin , Wanqing Li , Mohamad Fitri Faiz Bin Mahmood , Hao Feng , Zhen Zhao , Yangfan He , Kuan Lu , Yanjie Wang , Yuliang Liu , Hao Liu , Xiang Bai , Can Huang

Large Vision-Language Models (LVLMs) have demonstrated promising performance in chest X-ray (CXR) analysis. To enhance human-computer interaction, several studies have incorporated radiologists' eye gaze, typically through heatmaps or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yunsoo Kim , Jinge Wu , Honghan Wu

AI-driven models have shown great promise in detecting errors in radiology reports, yet the field lacks a unified benchmark for rigorous evaluation of error detection and further correction. To address this gap, we introduce CorBenchX, a…

Artificial Intelligence · Computer Science 2025-05-20 Jing Zou , Qingqiu Li , Chenyu Lian , Lihao Liu , Xiaohan Yan , Shujun Wang , Jing Qin

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Ultrasound acquisition requires skilled probe manipulation and real-time adjustments. Vision-language models (VLMs) could enable autonomous ultrasound systems, but existing benchmarks evaluate only static images, not dynamic procedural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Xucheng Wang , Xiaoman Zhang , Sung Eun Kim , Ankit Pal , Pranav Rajpurkar

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

Medical Visual Question Answering (MedVQA), which offers language responses to image-based medical inquiries, represents a challenging task and significant advancement in healthcare. It assists medical experts to swiftly interpret medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Xiaotang Gai , Chenyi Zhou , Jiaxiang Liu , Yang Feng , Jian Wu , Zuozhu Liu

Visual Question Answering (VQA) in the medical domain presents a unique, interdisciplinary challenge, combining fields such as Computer Vision, Natural Language Processing, and Knowledge Representation. Despite its importance, research in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Abhishek Narayanan , Rushabh Musthyala , Rahul Sankar , Anirudh Prasad Nistala , Pranav Singh , Jacopo Cirrone

AI-assisted report generation offers the opportunity to reduce radiologists' workload stemming from expanded screening guidelines, complex cases and workforce shortages, while maintaining diagnostic accuracy. In addition to describing…