中文
相关论文

相关论文: Robust Explanations for Visual Question Answering

200 篇论文

Visual Question Answering (VQA) requires AI models to comprehend data in two domains, vision and text. Current state-of-the-art models use learned attention mechanisms to extract relevant information from the input domains to answer a…

人工智能 · 计算机科学 2019-03-27 Ahmed Osman , Wojciech Samek

Several studies have recently pointed that existing Visual Question Answering (VQA) models heavily suffer from the language prior problem, which refers to capturing superficial statistical correlations between the question type and the…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Yudong Han , Liqiang Nie , Jianhua Yin , Jianlong Wu , Yan Yan

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zixu Wang , Yishu Miao , Lucia Specia

We study the problem of visual question answering (VQA) in images by exploiting supervised domain adaptation, where there is a large amount of labeled data in the source domain but only limited labeled data in the target domain with the…

计算机视觉与模式识别 · 计算机科学 2019-11-12 Yiming Xu , Lin Chen , Zhongwei Cheng , Lixin Duan , Jiebo Luo

Visual Question Answering (VQA) is a challenging task that requires cross-modal understanding and reasoning of visual image and natural language question. To inspect the association of VQA models to human cognition, we designed a survey to…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Liben Chen , Long Chen , Tian Ellison-Chen , Zhuoyuan Xu

We study the Knowledge-Based visual question-answering problem, for which given a question, the models need to ground it into the visual modality to find the answer. Although many recent works use question-dependent captioners to verbalize…

人工智能 · 计算机科学 2024-06-28 Elham J. Barezi , Parisa Kordjamshidi

Logical connectives and their implications on the meaning of a natural language sentence are a fundamental aspect of understanding. In this paper, we investigate whether visual question answering (VQA) systems trained to answer a question…

计算机视觉与模式识别 · 计算机科学 2020-07-17 Tejas Gokhale , Pratyay Banerjee , Chitta Baral , Yezhou Yang

Due to the significant advancement of Natural Language Processing and Computer Vision-based models, Visual Question Answering (VQA) systems are becoming more intelligent and advanced. However, they are still error-prone when dealing with…

计算机视觉与模式识别 · 计算机科学 2022-01-11 Zeyd Boukhers , Timo Hartmann , Jan Jürjens

Visual Question Answering (VQA) is a core task for evaluating the capabilities of Vision-Language Models (VLMs). Existing VQA benchmarks primarily feature clear and unambiguous image-question pairs, whereas real-world scenarios often…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jihyoung Jang , Hyounghun Kim

Audio-Visual Question Answering (AVQA) is a complex multi-modal reasoning task, demanding intelligent systems to accurately respond to natural language queries based on audio-video input pairs. Nevertheless, prevalent AVQA approaches are…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Jie Ma , Min Hu , Pinghui Wang , Wangchun Sun , Lingyun Song , Hongbin Pei , Jun Liu , Youtian Du

Medical Visual Question Answering (VQA) is a multi-modal challenging task widely considered by research communities of the computer vision and natural language processing. Since most current medical VQA models focus on visual content,…

计算机视觉与模式识别 · 计算机科学 2021-07-08 Haiwei Pan , Shuning He , Kejia Zhang , Bo Qu , Chunling Chen , Kun Shi

Visual question answering (VQA) for remote sensing scene has great potential in intelligent human-computer interaction system. Although VQA in computer vision has been widely researched, VQA for remote sensing data (RSVQA) is still in its…

计算机视觉与模式识别 · 计算机科学 2022-06-15 Zhenghang Yuan , Lichao Mou , Qi Wang , Xiao Xiang Zhu

Reasoning about causal and temporal event relations in videos is a new destination of Video Question Answering (VideoQA).The major stumbling block to achieve this purpose is the semantic gap between language and video since they are at…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Shaoning Xiao , Long Chen , Kaifeng Gao , Zhao Wang , Yi Yang , Zhimeng Zhang , Jun Xiao

In this paper, we present a novel approach for the task of eXplainable Question Answering (XQA), i.e., generating natural language (NL) explanations for the Visual Question Answering (VQA) problem. We generate NL explanations comprising of…

计算与语言 · 计算机科学 2019-02-18 Shalini Ghosh , Giedrius Burachas , Arijit Ray , Avi Ziskind

Visual question answering (VQA) is a task of answering a visual question that is a pair of question and image. Some visual questions are ambiguous and some are clear, and it may be appropriate to change the ambiguity of questions from…

计算机视觉与模式识别 · 计算机科学 2020-12-02 Kento Terao , Toru Tamaki , Bisser Raytchev , Kazufumi Kaneda , Shun'ichi Satoh

Visual Question Answering (VQA) models have achieved significant success in recent times. Despite the success of VQA models, they are mostly black-box models providing no reasoning about the predicted answer, thus raising questions for…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Nihar Bendre , Kevin Desai , Peyman Najafirad

Visual Question Answering (VQA) holds great potential for assisting Blind and Low Vision (BLV) users, yet real-world usage remains challenging. Due to visual impairments, BLV users often take blurry or poorly framed photos and face…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Wanyin Cheng , Zanxi Ruan

Visual Question Answering (VQA) is a recent problem in computer vision and natural language processing that has garnered a large amount of interest from the deep learning, computer vision, and natural language processing communities. In…

计算机视觉与模式识别 · 计算机科学 2017-06-16 Kushal Kafle , Christopher Kanan

Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of answering…

计算机视觉与模式识别 · 计算机科学 2017-12-05 Guohao Li , Hang Su , Wenwu Zhu