English
Related papers

Related papers: Synthesizing High-Quality Visual Question Answerin…

200 papers

Medical Visual Question Answering (Med-VQA) combines computer vision and natural language processing to automatically answer clinical inquiries about medical images. However, current Med-VQA datasets exhibit two significant limitations: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bo Liu , Ke Zou , Liming Zhan , Zexin Lu , Xiaoyu Dong , Yidi Chen , Chengqiang Xie , Jiannong Cao , Xiao-Ming Wu , Huazhu Fu

Medical Visual Question Answering (Med-VQA) represents a critical and challenging subtask within the general VQA domain. Despite significant advancements in general VQA, multimodal large language models (MLLMs) still exhibit substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Hongyu Ge , Longkun Hao , Zihui Xu , Zhenxin Lin , Bin Li , Shoujun Zhou , Hongjin Zhao , Yihang Liu

Vision-language models (VLMs) still struggle with visual perception tasks such as spatial understanding and viewpoint recognition. One plausible contributing factor is that natural image datasets provide limited supervision for low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Guanyu Zhou , Yida Yin , Wenhao Chai , Shengbang Tong , Xingyu Fu , Zhuang Liu

The rapid development of vision language models (VLMs) demands rigorous and reliable evaluation. However, current visual question answering (VQA) benchmarks often depend on open-ended questions, making accurate evaluation difficult due to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yuhui Zhang , Yuchang Su , Yiming Liu , Xiaohan Wang , James Burgess , Elaine Sui , Chenyu Wang , Josiah Aklilu , Alejandro Lozano , Anjiang Wei , Ludwig Schmidt , Serena Yeung-Levy

Visual Question Answering (VQA) requires reasoning across visual and textual modalities, yet Large Vision-Language Models (LVLMs) often lack integrated commonsense knowledge, limiting their robustness in real-world scenarios. To address…

Computation and Language · Computer Science 2025-06-12 Shuo Yang , Siwen Luo , Soyeon Caren Han , Eduard Hovy

Vision language models (VLMs) achieve strong performance on general image understanding but struggle to think with medical images, especially when performing multi-step reasoning through iterative visual interaction. Medical VLMs often rely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Meng Lu , Yuxing Lu , Yuchen Zhuang , Megan Mullins , Yang Xie , Guanghua Xiao , Charles Fleming , Wenqi Shi , Xuan Wang

In this paper, we establish a benchmark for table visual question answering, referred to as the TableVQA-Bench, derived from pre-existing table question-answering (QA) and table structure recognition datasets. It is important to note that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yoonsik Kim , Moonbin Yim , Ka Yeon Song

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

The emergence of Multimodal Large Language Models (MLLMs) that integrate vision and language modalities has unlocked new potentials for scientific reasoning, outperforming prior benchmarks in both natural language and coding domains.…

Computational Engineering, Finance, and Science · Computer Science 2025-05-27 Sifan Wu , Huan Zhang , Yizhan Li , Farshid Effaty , Amirreza Ataei , Bang Liu

Access to real-world medical data is often restricted due to privacy regulations, posing a significant barrier to the advancement of healthcare research. Synthetic data offers a promising alternative; however, generating realistic,…

Artificial Intelligence · Computer Science 2025-08-13 Arshia Ilaty , Hossein Shirazi , Hajar Homayouni

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

Recent advances in multimodal question answering have primarily focused on combining heterogeneous modalities or fine-tuning multimodal large language models. While these approaches have shown strong performance, they often rely on a…

Computation and Language · Computer Science 2026-04-22 Krishna Singh Rajput , Tejas Anvekar , Chitta Baral , Vivek Gupta

Biomedical text mining and question-answering are essential yet highly demanding tasks, particularly in the face of the exponential growth of biomedical literature. In this work, we present our participation in the 13th edition of the…

Computation and Language · Computer Science 2025-08-05 Dimitra Panou , Alexandros C. Dimopoulos , Manolis Koubarakis , Martin Reczko

Understanding the contents of multimodal documents is essential to accurately extract relevant evidence and use it for reasoning. Existing document understanding models tend to generate answers with a single word or phrase directly,…

Information Retrieval · Computer Science 2024-08-15 Jinxu Zhang

Medical Visual Question Answering (VQA) enhances clinical decision-making by enabling systems to interpret medical images and answer clinical queries. However, developing efficient, high-performance VQA models is challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Belal Alsinglawi , Chris McCarthy , Sara Webb , Christopher Fluke , Navid Toosy Saidy

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

Artificial Intelligence · Computer Science 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

Medical Visual Question Answering (MVQA) systems can interpret medical images in response to natural language queries. However, linguistic variability in question phrasing often undermines the consistency of these systems. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yongpei Ma , Pengyu Wang , Adam Dunn , Usman Naseem , Jinman Kim

Multimodal large language models (MLLMs) represent an evolutionary expansion in the capabilities of traditional large language models, enabling them to tackle challenges that surpass the scope of purely text-based applications. It leverages…

Computation and Language · Computer Science 2025-01-17 Jinlong He , Pengfei Li , Gang Liu , Genrong He , Zhaolin Chen , Shenjun Zhong

Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple images rather than interpreting a single view. We introduce MedThinkVQA, an expert-annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zonghai Yao , Benlu Wang , Yifan Zhang , Junda Wang , Iris Xia , Zhipeng Tang , Shuo Han , Feiyun Ouyang , Zhichao Yang , Arman Cohan , Hong Yu

Existing Multimodal Large Language Models (MLLMs) and Visual Language Pretrained Models (VLPMs) have shown remarkable performances in the general Visual Question Answering (VQA). However, these models struggle with VQA questions that…

Computation and Language · Computer Science 2024-11-06 Shuo Yang , Siwen Luo , Soyeon Caren Han