English
Related papers

Related papers: Speech-Based Visual Question Answering

200 papers

Visual question answering is a task of predicting the answer to a question about an image. Given that different people can provide different answers to a visual question, we aim to better understand why with answer groundings. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Chongyan Chen , Samreen Anjum , Danna Gurari

Visual Question Answering (VQA) attracts much attention from both industry and academia. As a multi-modality task, it is challenging since it requires not only visual and textual understanding, but also the ability to align cross-modality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Peixi Xiong , Quanzeng You , Pei Yu , Zicheng Liu , Ying Wu

Visual Query Answering (VQA) is of great significance in offering people convenience: one can raise a question for details of objects, or high-level understanding about the scene, over an image. This paper proposes a novel method to address…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Peixi Xiong , Huayi Zhan , Xin Wang , Baivab Sinha , Ying Wu

In this paper, we propose a novel deep multi-level attention model to address inverse visual question answering. The proposed model generates regional visual and semantic features at the object level and then enhances them with the answer…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Yaser Alwattar , Yuhong Guo

Knowledge-based visual question answering (VQA) requires answering questions with external knowledge in addition to the content of images. One dataset that is mostly used in evaluating knowledge-based VQA is OK-VQA, but it lacks a gold…

Computation and Language · Computer Science 2021-09-10 Man Luo , Yankai Zeng , Pratyay Banerjee , Chitta Baral

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

Computation and Language · Computer Science 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

In this paper, we propose a method to obtain robust explanations for visual question answering(VQA) that correlate well with the answers. Our model explains the answers obtained through a VQA model by providing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Badri N. Patro , Shivansh Pate , Vinay P. Namboodiri

While Vector Symbolic Architectures (VSAs) are promising for modelling spatial cognition, their application is currently limited to artificially generated images and simple spatial queries. We propose VSA4VQA - a novel 4D implementation of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Anna Penzkofer , Lei Shi , Andreas Bulling

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Aditya Kane , V Manushree , Sahil Khose

In this paper, we propose the first model to be able to generate visually grounded questions with diverse types for a single image. Visual question generation is an emerging topic which aims to ask questions in natural language based on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Shijie Zhang , Lizhen Qu , Shaodi You , Zhenglu Yang , Jiawan Zhang

Typical active learning strategies are designed for tasks, such as classification, with the assumption that the output space is mutually exclusive. The assumption that these tasks always have exactly one correct answer has resulted in the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Khaled Jedoui , Ranjay Krishna , Michael Bernstein , Li Fei-Fei

Recently visual question answering (VQA) and visual question generation (VQG) are two trending topics in the computer vision, which have been explored separately. In this work, we propose an end-to-end unified framework, the Invertible…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Yikang Li , Nan Duan , Bolei Zhou , Xiao Chu , Wanli Ouyang , Xiaogang Wang

Much recent progress in Vision-to-Language problems has been achieved through a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). This approach does not explicitly represent high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-12-19 Qi Wu , Chunhua Shen , Anton van den Hengel , Peng Wang , Anthony Dick

Visual question answering (VQA) is a task of answering a visual question that is a pair of question and image. Some visual questions are ambiguous and some are clear, and it may be appropriate to change the ambiguity of questions from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Kento Terao , Toru Tamaki , Bisser Raytchev , Kazufumi Kaneda , Shun'ichi Satoh

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

How far can we go with textual representations for understanding pictures? In image understanding, it is essential to use concise but detailed image representations. Deep visual features extracted by vision models, such as Faster R-CNN, are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Yusuke Hirota , Noa Garcia , Mayu Otani , Chenhui Chu , Yuta Nakashima , Ittetsu Taniguchi , Takao Onoye

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

Computation and Language · Computer Science 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

Questions that require counting a variety of objects in images remain a major challenge in visual question answering (VQA). The most common approaches to VQA involve either classifying answers based on fixed length representations of both…

Artificial Intelligence · Computer Science 2018-03-05 Alexander Trott , Caiming Xiong , Richard Socher

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Jialin Wu , Raymond J. Mooney

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi