English
Related papers

Related papers: WorldMedQA-V: a multilingual, multimodal medical e…

200 papers

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little…

Artificial Intelligence · Computer Science 2025-08-12 Shengtao Wen , Haodong Chen , Yadong Wang , Zhongying Pan , Xiang Chen , Yu Tian , Bo Qian , Dong Liang , Sheng-Jun Huang

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in various tasks. However, effectively evaluating these MLLMs on face perception remains largely unexplored. To address this gap, we introduce FaceBench, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Xiaoqin Wang , Xusen Ma , Xianxu Hou , Meidan Ding , Yudong Li , Junliang Chen , Wenting Chen , Xiaoyang Peng , Linlin Shen

Visual Question Answering (VQA) has become an important benchmark for assessing how large multimodal models (LMMs) interpret images. However, most VQA datasets focus on real-world images or simple diagrammatic analysis, with few focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jill P. Naiman , Daniel J. Evans , JooYoung Seo

Recent advancements in Large Multimodal Models (LMMs) have shown promising results in mathematical reasoning within visual contexts, with models approaching human-level performance on existing benchmarks such as MathVista. However, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Ke Wang , Junting Pan , Weikang Shi , Zimu Lu , Mingjie Zhan , Hongsheng Li

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Images in the medical domain are fundamentally different from the general domain images. Consequently, it is infeasible to directly employ general domain Visual Question Answering (VQA) models for the medical domain. Additionally, medical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yash Khare , Viraj Bagal , Minesh Mathew , Adithi Devi , U Deva Priyakumar , CV Jawahar

Evaluating large language models (LLMs) has recently emerged as a critical issue for safe and trustworthy application of LLMs in the medical domain. Although a variety of static medical question-answering (QA) benchmarks have been proposed,…

Computation and Language · Computer Science 2025-12-12 Gyutaek Oh , Sangjoon Park , Byung-Hoon Kim

The rise of Visual-Language Models (LVLMs) has unlocked new possibilities for seamlessly integrating visual and textual information. However, their ability to interpret cartographic maps remains largely unexplored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Huy Quang Ung , Guillaume Habault , Yasutaka Nishimura , Hao Niu , Roberto Legaspi , Tomoki Oya , Ryoichi Kojima , Masato Taya , Chihiro Ono , Atsunori Minamikawa , Yan Liu

Traditional Chinese Medicine (TCM), as an effective alternative medicine, has been receiving increasing attention. In recent years, the rapid development of large language models (LLMs) tailored for TCM has highlighted the urgent need for…

Computation and Language · Computer Science 2025-10-28 Jiacheng Xie , Yang Yu , Ziyang Zhang , Shuai Zeng , Jiaxuan He , Ayush Vasireddy , Xiaoting Tang , Congyu Guo , Lening Zhao , Congcong Jing , Guanghui An , Dong Xu

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Large language models (LLMs) show significant potential in healthcare, prompting numerous benchmarks to evaluate their capabilities. However, concerns persist regarding the reliability of these benchmarks, which often lack clinical…

Computation and Language · Computer Science 2026-04-30 Wenting Chen , Guo Yu , Yiu-Fai Cheung , Meidan Ding , Jie Liu , Zizhan Ma , Wenxuan Wang , Linlin Shen

Large language models (LLMs) show promise for clinical use. They are often evaluated using datasets such as MedQA. However, Many medical datasets, such as MedQA, rely on simplified Question-Answering (Q\A) that underrepresents real-world…

Computation and Language · Computer Science 2025-10-24 Yunpeng Xiao , Carl Yang , Mark Mai , Xiao Hu , Kai Shu

Large Language Models (LLMs) have demonstrated significant promise for various applications in healthcare. However, their efficacy in the Arabic medical domain remains unexplored due to the lack of high-quality domain-specific datasets and…

Computation and Language · Computer Science 2025-08-25 Mouath Abu Daoud , Chaimae Abouzahir , Leen Kharouf , Walid Al-Eisawi , Nizar Habash , Farah E. Shamout

Medical visual question answering (VQA) is a challenging task that requires answering clinical questions of a given medical image, by taking consider of both visual and language information. However, due to the small scale of training data…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Pengfei Li , Gang Liu , Jinlong He , Zixu Zhao , Shenjun Zhong

Foundation models and vision-language pre-training have notably advanced Vision Language Models (VLMs), enabling multimodal processing of visual and linguistic data. However, their performance has been typically assessed on general scene…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Shravan Nayak , Kanishk Jain , Rabiul Awal , Siva Reddy , Sjoerd van Steenkiste , Lisa Anne Hendricks , Karolina Stańczak , Aishwarya Agrawal

Visual question answering (VQA) in medical imaging aims to support clinical diagnosis by automatically interpreting complex imaging data in response to natural language queries. Existing studies typically rely on distinct visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yuanhe Tian , Chen Su , Junwen Duan , Yan Song

Medical visual question answering aims to support clinical decision-making by enabling models to answer natural language questions based on medical images. While recent advances in multi-modal learning have significantly improved…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Bo Liu , Xiangyu Zhao , Along He , Yidi Chen , Huazhu Fu , Xiao-Ming Wu

Multimodal Large Language Models (MLLMs) have shown promising capabilities in mathematical reasoning within visual contexts across various datasets. However, most existing multimodal math benchmarks are limited to single-visual contexts,…

Artificial Intelligence · Computer Science 2025-08-04 Peijie Wang , Zhong-Zhi Li , Fei Yin , Xin Yang , Dekang Ran , Cheng-Lin Liu

Recent Multimodal Large Language Models (MLLMs) achieve promising performance on visual and audio benchmarks independently. However, the ability of these models to process cross-modal information synchronously remains largely unexplored. We…

Artificial Intelligence · Computer Science 2026-03-12 Ziwei Zhou , Rui Wang , Zuxuan Wu , Yu-Gang Jiang