English
Related papers

Related papers: Synthesizing High-Quality Visual Question Answerin…

200 papers

In the era of modern healthcare, swiftly generating medical question summaries is crucial for informed and timely patient care. Despite the increasing complexity and volume of medical data, existing studies have focused solely on text-based…

Artificial Intelligence · Computer Science 2023-12-20 Akash Ghosh , Arkadeep Acharya , Raghav Jain , Sriparna Saha , Aman Chadha , Setu Sinha

Question decomposition has emerged as an effective strategy for prompting Large Language Models (LLMs) to answer complex questions. However, while existing methods primarily focus on unimodal language models, the question decomposition…

Computation and Language · Computer Science 2024-10-08 Haowei Zhang , Jianzhe Liu , Zhen Han , Shuo Chen , Bailan He , Volker Tresp , Zhiqiang Xu , Jindong Gu

Despite rapid progress, multimodal reasoning still lacks a systematic approach to synthesize large-scale vision-centric datasets beyond visual math. We introduce a framework able to synthesize vision-centric problems spanning diverse levels…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 David Acuna , Chao-Han Huck Yang , Yuntian Deng , Jaehun Jung , Ximing Lu , Prithviraj Ammanabrolu , Hyunwoo Kim , Yuan-Hong Liao , Yejin Choi

Medical Visual Question Answering (Med-VQA) is a very important task in healthcare industry, which answers a natural language question with a medical image. Existing VQA techniques in information systems can be directly applied to solving…

Artificial Intelligence · Computer Science 2023-12-14 Xiaojie Hong , Zixin Song , Liangzhi Li , Xiaoli Wang , Feiyan Liu

Recent advancements in Large Language Models (LLMs) and Large Vision Language Models (LVLMs) have enabled general-purpose systems to demonstrate promising capabilities in complex reasoning tasks, including those in the medical domain.…

Computation and Language · Computer Science 2026-05-19 Rafid Ahmed , Intesar Tahmid , Mir Sazzat Hossain , Tasnimul Hossain Tomal , Md Fahim , Md Farhad Alam Bhuiyan

Recent advances in Large Language Models (LLMs) have shown that their reasoning capabilities can be significantly improved through Reinforcement Learning with Verifiable Reward (RLVR), particularly in domains like mathematics and…

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Clinical Question Answering (QA) systems enable doctors to quickly access patient information from electronic health records (EHRs). However, training these systems requires significant annotated data, which is limited due to the expertise…

Computation and Language · Computer Science 2024-12-09 Fan Bai , Keith Harrigian , Joel Stremmel , Hamid Hassanzadeh , Ardavan Saeedi , Mark Dredze

Synthetic data generation using large language models (LLMs) demonstrates substantial promise in addressing biomedical data challenges and shows increasing adoption in biomedical research. This study systematically reviews recent advances…

Computation and Language · Computer Science 2026-02-18 Hanshu Rao , Weisi Liu , Haohan Wang , I-Chan Huang , Zhe He , Xiaolei Huang

Recent Large Vision-Language Models (LVLMs) have shown promising reasoning capabilities on text-rich images from charts, tables, and documents. However, the abundant text within such images may increase the model's sensitivity to language.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xinmiao Yu , Xiaocheng Feng , Yun Li , Minghui Liao , Ya-Qi Yu , Xiachong Feng , Weihong Zhong , Ruihan Chen , Mengkang Hu , Jihao Wu , Dandan Tu , Duyu Tang , Bing Qin

Medical vision--language models (VLMs) are usually evaluated on intact image--question pairs, but trustworthy clinical use requires a stronger property: a model must recognise when the evidential basis for an answer has failed. We study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hanqi Jiang , Junhao Chen , Mingyu Kang , Hyeokjae Kwon , Yi Pan , Lifeng Chen , Weihang You , Haozhen Gong , Ruiyu Yan , Jinglei Lv , Lin Zhao , Hui Ren , Quanzheng Li , Tianming Liu , Xiang Li

The reasoning gap between large and compact vision-language models (VLMs) limits the deployment of medical AI on portable clinical devices. Compact VLMs of 2--4B parameters can run on resource-constrained hardware but lack the multi-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Runze Ma , Shunbo Jia , Haonan Lyu , Guo Liu , Caizhi Liao

Multi-modal Large Language Models (MLLMs) have introduced a novel dimension to document understanding, i.e., they endow large language models with visual comprehension capabilities; however, how to design a suitable image-text pre-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zining Wang , Tongkun Guan , Pei Fu , Chen Duan , Qianyi Jiang , Zhentao Guo , Shan Guo , Junfeng Luo , Wei Shen , Xiaokang Yang

Training vision-language models (VLMs) typically requires large-scale, high-quality image-text pairs, but collecting or synthesizing such data is costly. In contrast, text data is abundant and inexpensive, prompting the question: can…

Artificial Intelligence · Computer Science 2026-05-28 Xiaomin Yu , Wenjie Zhang , Ziyue Qiao , Chengwei Qin , Hui Xiong

Medical Visual Question Answering (VQA) systems play a supporting role to understand clinic-relevant information carried by medical images. The questions to a medical image include two categories: close-end (such as Yes/No question) and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yunyi Liu , Zhanyu Wang , Dong Xu , Luping Zhou

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Multimodal Large Language Models (MLLMs) demonstrate exceptional problem-solving capabilities, but few research studies aim to gauge the ability to generate visual instruction tuning data. This paper proposes to explore the potential of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Henry Hengyuan Zhao , Pan Zhou , Mike Zheng Shou

With the growing use of language models (LMs) in clinical environments, there is an immediate need to evaluate the accuracy and safety of LM-generated medical text. Currently, such evaluation relies solely on manual physician review.…

Large Vision-Language Models (LVLMs) have shown significant potential in assisting medical diagnosis by leveraging extensive biomedical datasets. However, the advancement of medical image understanding and reasoning critically depends on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Guohao Sun , Can Qin , Huazhu Fu , Linwei Wang , Zhiqiang Tao

Large Language Models (LLMs) have significantly advanced automated test generation, yet existing methods often rely on ground-truth code for verification, risking bug propagation and limiting applicability in test-driven development. We…

Software Engineering · Computer Science 2026-02-12 Hamed Taherkhani , Alireza DaghighFarsoodeh , Mohammad Chowdhury , Hung Viet Pham , Hadi Hemmati