中文
相关论文

相关论文: PMC-VQA: Visual Instruction Tuning for Medical Vis…

200 篇论文

The increase in the availability of online videos has transformed the way we access information and knowledge. A growing number of individuals now prefer instructional videos as they offer a series of step-by-step procedures to accomplish…

计算与语言 · 计算机科学 2023-09-22 Deepak Gupta , Kush Attal , Dina Demner-Fushman

Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous systems, where models must provide not only accurate…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Xingjian Diao , Weiyi Wu , Keyi Kong , Peijun Qing , Xinwen Xu , Ming Cheng , Soroush Vosoughi , Jiang Gui

We introduce MedXpertQA, a highly challenging and comprehensive benchmark to evaluate expert-level medical knowledge and advanced reasoning. MedXpertQA includes 4,460 questions spanning 17 specialties and 11 body systems. It includes two…

人工智能 · 计算机科学 2025-06-09 Yuxin Zuo , Shang Qu , Yifei Li , Zhangren Chen , Xuekai Zhu , Ermo Hua , Kaiyan Zhang , Ning Ding , Bowen Zhou

We propose Encyclopedic-VQA, a large scale visual question answering (VQA) dataset featuring visual questions about detailed properties of fine-grained categories and instances. It contains 221k unique question+answer pairs each matched…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Thomas Mensink , Jasper Uijlings , Lluis Castrejon , Arushi Goel , Felipe Cadar , Howard Zhou , Fei Sha , André Araujo , Vittorio Ferrari

The Medico 2025 challenge addresses Visual Question Answering (VQA) for Gastrointestinal (GI) imaging, organized as part of the MediaEval task series. The challenge focuses on developing Explainable Artificial Intelligence (XAI) models that…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Sushant Gautam , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Steven Hicks

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Duong T. Tran , Trung-Kien Tran , Manfred Hauswirth , Danh Le Phuoc

Multimodal Large Language Models are increasingly applied to biomedical imaging, yet scientific reasoning for microscopy remains limited by the scarcity of large-scale, high-quality training data. We introduce MicroVQA++, a three-stage,…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Manyu Li , Ruian He , Chenxi Ma , Weimin Tan , Bo Yan

Visual question answering (VQA) is an important and challenging multimodal task in computer vision. Recently, a few efforts have been made to bring VQA task to aerial images, due to its potential real-world applications in disaster…

计算机视觉与模式识别 · 计算机科学 2023-01-24 Kun Li , George Vosselman , Michael Ying Yang

Problems at the intersection of vision and language are of significant importance both as challenging research questions and for the rich set of applications they enable. However, inherent structure in our world and bias in our language…

计算机视觉与模式识别 · 计算机科学 2017-05-16 Yash Goyal , Tejas Khot , Douglas Summers-Stay , Dhruv Batra , Devi Parikh

Visual Question Answering (VQA) is a core task for evaluating the capabilities of Vision-Language Models (VLMs). Existing VQA benchmarks primarily feature clear and unambiguous image-question pairs, whereas real-world scenarios often…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jihyoung Jang , Hyounghun Kim

Multimodal vision-language models (VLMs) continue to achieve ever-improving scores on chart understanding benchmarks. Yet, we find that this progress does not fully capture the breadth of visual reasoning capabilities essential for…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Kushin Mukherjee , Donghao Ren , Dominik Moritz , Yannick Assogba

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

计算与语言 · 计算机科学 2019-07-12 Drew A. Hudson , Christopher D. Manning

Chain-of-thought (CoT) reasoning has advanced medical visual question answering (VQA), yet most existing CoT rationales are free-form and fail to capture the structured reasoning process clinicians actually follow. This work asks: Can…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Lin Fan , Yafei Ou , Zhipeng Deng , Pengyu Dai , Hou Chongxian , Jiale Yan , Yaqian Li , Kaiwen Long , Xun Gong , Masayuki Ikebe , Yefeng Zheng

The emergence of Multimodal Large Language Models (MLLMs) that integrate vision and language modalities has unlocked new potentials for scientific reasoning, outperforming prior benchmarks in both natural language and coding domains.…

计算工程、金融与科学 · 计算机科学 2025-05-27 Sifan Wu , Huan Zhang , Yizhan Li , Farshid Effaty , Amirreza Ataei , Bang Liu

Visual Question Answering in Medical domain (VQA-Med) plays an important role in providing medical assistance to the end-users. These users are expected to raise either a straightforward question with a Yes/No answer or a challenging…

计算与语言 · 计算机科学 2020-09-29 Deepak Gupta , Swati Suman , Asif Ekbal

Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating…

计算机视觉与模式识别 · 计算机科学 2020-01-07 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this concept by adding…

计算与语言 · 计算机科学 2024-06-17 Manas Jhalani , Annervaz K M , Pushpak Bhattacharyya

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in…