English
Related papers

Related papers: ReXVQA: A Large-scale Visual Question Answering Be…

200 papers

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in various multimodal tasks. However, their potential in the medical domain remains largely unexplored. A significant challenge arises from the scarcity of…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Yutao Hu , Tianbin Li , Quanfeng Lu , Wenqi Shao , Junjun He , Yu Qiao , Ping Luo

We present NeuroQA, a large-scale benchmark for visual question answering in 3D brain magnetic resonance imaging (MRI), with 56,953 QA pairs from 12,977 subjects across 12 datasets. It spans ages 5-104 and five clinical domains:…

The scarcity of well-annotated diverse medical images is a major hurdle for developing reliable AI models in healthcare. Substantial technical advances have been made in generative foundation models for natural images. Here we develop…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yuanfeng Ji , Dan Lin , Xiyue Wang , Lu Zhang , Wenhui Zhou , Chongjian Ge , Ruihang Chu , Xiaoli Yang , Junhan Zhao , Junsong Chen , Xiangde Luo , Sen Yang , Jin Fang , Ping Luo , Ruijiang Li

Visual Question Answering (VQA) is an important task in multimodal AI, and it is often used to test the ability of vision-language models to understand and reason on knowledge present in both visual and textual data. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 David Romero , Chenyang Lyu , Haryo Akbarianto Wibowo , Teresa Lynn , Injy Hamed , Aditya Nanda Kishore , Aishik Mandal , Alina Dragonetti , Artem Abzaliev , Atnafu Lambebo Tonja , Bontu Fufa Balcha , Chenxi Whitehouse , Christian Salamea , Dan John Velasco , David Ifeoluwa Adelani , David Le Meur , Emilio Villa-Cueva , Fajri Koto , Fauzan Farooqui , Frederico Belcavello , Ganzorig Batnasan , Gisela Vallejo , Grainne Caulfield , Guido Ivetta , Haiyue Song , Henok Biadglign Ademtew , Hernán Maina , Holy Lovenia , Israel Abebe Azime , Jan Christian Blaise Cruz , Jay Gala , Jiahui Geng , Jesus-German Ortiz-Barajas , Jinheon Baek , Jocelyn Dunstan , Laura Alonso Alemany , Kumaranage Ravindu Yasas Nagasinghe , Luciana Benotti , Luis Fernando D'Haro , Marcelo Viridiano , Marcos Estecha-Garitagoitia , Maria Camila Buitrago Cabrera , Mario Rodríguez-Cantelar , Mélanie Jouitteau , Mihail Mihaylov , Mohamed Fazli Mohamed Imam , Muhammad Farid Adilazuarda , Munkhjargal Gochoo , Munkh-Erdene Otgonbold , Naome Etori , Olivier Niyomugisha , Paula Mónica Silva , Pranjal Chitale , Raj Dabre , Rendi Chevi , Ruochen Zhang , Ryandito Diandaru , Samuel Cahyawijaya , Santiago Góngora , Soyeong Jeong , Sukannya Purkayastha , Tatsuki Kuribayashi , Teresa Clifford , Thanmay Jayakumar , Tiago Timponi Torrent , Toqeer Ehsan , Vladimir Araujo , Yova Kementchedjhieva , Zara Burzo , Zheng Wei Lim , Zheng Xin Yong , Oana Ignat , Joan Nwatu , Rada Mihalcea , Thamar Solorio , Alham Fikri Aji

As artificial intelligence (AI) becomes increasingly central to healthcare, the demand for explainable and trustworthy models is paramount. Current report generation systems for chest X-rays (CXR) often lack mechanisms for validating…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Sayeh Gholipour Picha , Dawood Al Chanti , Alice Caplier

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal understanding, yet their capabilities for scientific reasoning remain inadequately assessed. Current multimodal benchmarks predominantly evaluate generic…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ai Jian , Weijie Qiu , Xiaokun Wang , Peiyu Wang , Yunzhuo Hao , Jiangbo Pei , Yichen Wei , Yi Peng , Xuchen Song

The Medico 2025 challenge addresses Visual Question Answering (VQA) for Gastrointestinal (GI) imaging, organized as part of the MediaEval task series. The challenge focuses on developing Explainable Artificial Intelligence (XAI) models that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Sushant Gautam , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Steven Hicks

Recently large vision-language models have shown potential when interpreting complex images and generating natural language descriptions using advanced reasoning. Medicine's inherently multimodal nature incorporating scans and text-based…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Naman Sharma

We present a scalable, bottom-up and intrinsically diverse data collection scheme that can be used for high-level reasoning with long and medium horizons and that has 2.2x higher throughput compared to traditional narrow top-down…

Remote Sensing Visual Question Answering (RSVQA) is a challenging task that involves interpreting complex satellite imagery to answer natural language questions. Traditional approaches often rely on separate visual feature extractors and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Surasakdi Siripong , Apirak Chaiyapan , Thanakorn Phonchai

The diagnosis and treatment of chest diseases play a crucial role in maintaining human health. X-ray examination has become the most common clinical examination means due to its efficiency and cost-effectiveness. Artificial intelligence…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Jingfeng Yao , Xinggang Wang , Yuehao Song , Huangxuan Zhao , Jun Ma , Yajie Chen , Wenyu Liu , Bo Wang

Purpose: To benchmark open-source or commercial medical image-specific VLMs against real-world radiologist-written reports. Methods: This retrospective study included adult patients who presented to the emergency department between January…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Woo Hyeon Lim , Ji Young Lee , Jong Hyuk Lee , Saehoon Kim , Hyungjin Kim

Chest X-rays (CXRs) play an integral role in driving critical decisions in disease management and patient care. While recent innovations have led to specialized models for various CXR interpretation tasks, these solutions often operate in…

Machine Learning · Computer Science 2025-05-30 Adibvafa Fallahpour , Jun Ma , Alif Munim , Hongwei Lyu , Bo Wang

Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple images rather than interpreting a single view. We introduce MedThinkVQA, an expert-annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zonghai Yao , Benlu Wang , Yifan Zhang , Junda Wang , Iris Xia , Zhipeng Tang , Shuo Han , Feiyun Ouyang , Zhichao Yang , Arman Cohan , Hong Yu

In this paper, we establish a benchmark for table visual question answering, referred to as the TableVQA-Bench, derived from pre-existing table question-answering (QA) and table structure recognition datasets. It is important to note that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yoonsik Kim , Moonbin Yim , Ka Yeon Song

We introduce MedXpertQA, a highly challenging and comprehensive benchmark to evaluate expert-level medical knowledge and advanced reasoning. MedXpertQA includes 4,460 questions spanning 17 specialties and 11 body systems. It includes two…

Artificial Intelligence · Computer Science 2025-06-09 Yuxin Zuo , Shang Qu , Yifei Li , Zhangren Chen , Xuekai Zhu , Ermo Hua , Kaiyan Zhang , Ning Ding , Bowen Zhou

Research question: How can we establish an AI support for reading of chest X-rays in clinical routine and which benefits emerge for the clinicians and radiologists. Can it perform 24/7 support for practicing clinicians? 2. Findings: We…

Image and Video Processing · Electrical Eng. & Systems 2022-10-21 Karsten Ridder , Alexander Preuhs , Axel Mertins , Clemens Joerger

Studies have shown that a dominant class of questions asked by visually impaired users on images of their surroundings involves reading text in the image. But today's VQA models can not read! Our paper takes a first step towards addressing…

Computation and Language · Computer Science 2019-05-15 Amanpreet Singh , Vivek Natarajan , Meet Shah , Yu Jiang , Xinlei Chen , Dhruv Batra , Devi Parikh , Marcus Rohrbach

Understanding the fine-grained articulation of human hands is critical in high-stakes settings such as robot-assisted surgery, chip manufacturing, and AR/VR-based human-AI interaction. Despite achieving near-human performance on general…

Visual question answering is an important task in both natural language and vision understanding. However, in most of the public visual question answering datasets such as VQA, CLEVR, the questions are human generated that specific to the…

Computation and Language · Computer Science 2022-08-08 Bingning Wang , Feiyang Lv , Ting Yao , Yiming Yuan , Jin Ma , Yu Luo , Haijin Liang