中文
相关论文

相关论文: Beyond Question-Based Biases: Assessing Multimodal…

200 篇论文

Visual question answering (Visual QA) has attracted a lot of attention lately, seen essentially as a form of (visual) Turing test that artificial intelligence should strive to achieve. In this paper, we study a crucial component of this…

计算与语言 · 计算机科学 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha

Recent research on Vision Language Models (VLMs) suggests that they rely on inherent biases learned during training to respond to questions about visual properties of an image. These biases are exacerbated when VLMs are asked highly…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

3D Visual Question Answering (3D VQA) is crucial for enabling models to perceive the physical world and perform spatial reasoning. In 3D VQA, the free-form nature of answers often leads to improper annotations that can confuse or mislead…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Shengli Zhou , Yang Liu , Feng Zheng

Multimodal Large Language Models (MLLMs) demonstrate strong capabilities in handling image-text inputs. A common way to assess this ability is through multiple-choice Visual Question Answering (VQA). Earlier works have already revealed that…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Fabio Rosenthal , Sebastian Schmidt , Thorsten Graf , Thorsten Bagodonat , Stephan Günnemann , Leo Schwinn

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Visual Question Answering (VQA) holds great potential for assisting Blind and Low Vision (BLV) users, yet real-world usage remains challenging. Due to visual impairments, BLV users often take blurry or poorly framed photos and face…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Wanyin Cheng , Zanxi Ruan

Visual question answering (VQA) is the multi-modal task of answering natural language questions about an input image. Through cross-dataset adaptation methods, it is possible to transfer knowledge from a source dataset with larger train…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Arjun R. Akula

Medical Visual Question Answering (VQA) is a multi-modal challenging task widely considered by research communities of the computer vision and natural language processing. Since most current medical VQA models focus on visual content,…

计算机视觉与模式识别 · 计算机科学 2021-07-08 Haiwei Pan , Shuning He , Kejia Zhang , Bo Qu , Chunling Chen , Kun Shi

Most existing works in visual question answering (VQA) are dedicated to improving the accuracy of predicted answers, while disregarding the explanations. We argue that the explanation for an answer is of the same or even more importance…

计算机视觉与模式识别 · 计算机科学 2018-08-28 Qing Li , Qingyi Tao , Shafiq Joty , Jianfei Cai , Jiebo Luo

Attention mechanisms have been widely used in Visual Question Answering (VQA) solutions due to their capacity to model deep cross-domain interactions. Analyzing attention maps offers us a perspective to find out limitations of current VQA…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Wei Li , Zehuan Yuan , Xiangzhong Fang , Changhu Wang

Visual Question Answering (VQA) is a novel problem domain where multi-modal inputs must be processed in order to solve the task given in the form of a natural language. As the solutions inherently require to combine visual and natural…

计算机视觉与模式识别 · 计算机科学 2018-01-31 Mikyas T. Desta , Larry Chen , Tomasz Kornuta

Multiple Choice Question Answering (MCQA) benchmarks are an established standard for measuring Vision Language Model (VLM) performance in driving tasks. However, we observe the known phenomenon that synthetically generated MCQAs are highly…

机器学习 · 计算机科学 2026-02-23 Sutej Kulgod , Sean Ye , Sanchit Tanwar , Christoffer Heckman

Visual question answering (VQA) for remote sensing scene has great potential in intelligent human-computer interaction system. Although VQA in computer vision has been widely researched, VQA for remote sensing data (RSVQA) is still in its…

计算机视觉与模式识别 · 计算机科学 2022-06-15 Zhenghang Yuan , Lichao Mou , Qi Wang , Xiao Xiang Zhu

Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous systems, where models must provide not only accurate…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Xingjian Diao , Weiyi Wu , Keyi Kong , Peijun Qing , Xinwen Xu , Ming Cheng , Soroush Vosoughi , Jiang Gui

Joint vision and language tasks like visual question answering are fascinating because they explore high-level understanding, but at the same time, can be more prone to language biases. In this paper, we explore the biases in the MovieQA…

计算机视觉与模式识别 · 计算机科学 2019-11-11 Bhavan Jasani , Rohit Girdhar , Deva Ramanan

Question categorization and expert retrieval methods have been crucial for information organization and accessibility in community question & answering (CQA) platforms. Research in this area, however, has dealt with only the text modality.…

计算与语言 · 计算机科学 2019-05-28 Avikalp Srivastava , Hsin Wen Liu , Sumio Fujita

Methodologies for training visual question answering (VQA) models assume the availability of datasets with human-annotated \textit{Image-Question-Answer} (I-Q-A) triplets. This has led to heavy reliance on datasets and a lack of…

计算机视觉与模式识别 · 计算机科学 2021-05-31 Pratyay Banerjee , Tejas Gokhale , Yezhou Yang , Chitta Baral

We propose the inverse problem of Visual question answering (iVQA), and explore its suitability as a benchmark for visuo-linguistic understanding. The iVQA task is to generate a question that corresponds to a given image and answer pair.…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

We investigate the problem of cross-dataset adaptation for visual question answering (Visual QA). Our goal is to train a Visual QA model on a source dataset but apply it to another target one. Analogous to domain adaptation for visual…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha