English
Related papers

Related papers: Exploring Models and Data for Image Question Answe…

200 papers

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

Computer Vision and Pattern Recognition · Computer Science 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

While a lot of work has been done on developing models to tackle the problem of Visual Question Answering, the ability of these models to relate the question to the image features still remain less explored. We present an empirical study of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Harsh Raj , Janhavi Dadhania , Akhilesh Bhardwaj , Prabuchandran KJ

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Kushal Kafle , Christopher Kanan

Visual Question Answering (VQA) is a recent problem in computer vision and natural language processing that has garnered a large amount of interest from the deep learning, computer vision, and natural language processing communities. In…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Kushal Kafle , Christopher Kanan

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Damien Teney , Anton van den Hengel

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Supriya Pandhre , Shagun Sodhani

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Damien Teney , Anton van den Hengel

Though beneficial for encouraging the Visual Question Answering (VQA) models to discover the underlying knowledge by exploiting the input-output correlation beyond image and text contexts, the existing knowledge VQA datasets are mostly…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Qingxing Cao , Bailin Li , Xiaodan Liang , Keze Wang , Liang Lin

Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of answering…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Guohao Li , Hang Su , Wenwu Zhu

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Xiao Lin , Devi Parikh

Visual question answering (VQA) task not only bridges the gap between images and language, but also requires that specific contents within the image are understood as indicated by linguistic context of the question, in order to generate the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Kuniaki Saito , Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

The last several years have seen intensive interest in exploring neural-network-based models for machine comprehension (MC) and question answering (QA). In this paper, we approach the problems by closely modelling questions in a neural…

Computation and Language · Computer Science 2017-03-28 Junbei Zhang , Xiaodan Zhu , Qian Chen , Lirong Dai , Si Wei , Hui Jiang

In this paper, we present the mQA model, which is able to answer questions about the content of an image. The answer can be a sentence, a phrase or a single word. Our model contains four components: a Long Short-Term Memory (LSTM) to…

Computer Vision and Pattern Recognition · Computer Science 2015-11-04 Haoyuan Gao , Junhua Mao , Jie Zhou , Zhiheng Huang , Lei Wang , Wei Xu

We present a novel mechanism to embed prior knowledge in a model for visual question answering. The open-set nature of the task is at odds with the ubiquitous approach of training of a fixed classifier. We show how to exploit additional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Violetta Shevchenko , Damien Teney , Anthony Dick , Anton van den Hengel

We propose a method for visual question answering which combines an internal representation of the content of an image with information extracted from a general knowledge base to answer a broad range of image-based questions. This allows…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Qi Wu , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Answering questions related to art pieces (paintings) is a difficult task, as it implies the understanding of not only the visual information that is shown in the picture, but also the contextual knowledge that is acquired through the study…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Noa Garcia , Chentao Ye , Zihua Liu , Qingtao Hu , Mayu Otani , Chenhui Chu , Yuta Nakashima , Teruko Mitamura

Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially common-sense KGs, are…

Computation and Language · Computer Science 2021-06-22 Kiran Ramnath , Mark Hasegawa-Johnson

Question Answering (QA) is one of the most important natural language processing (NLP) tasks. It aims using NLP technologies to generate a corresponding answer to a given question based on the massive unstructured corpus. With the…

Computation and Language · Computer Science 2022-07-01 Zhen Wang

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Huijuan Xu , Kate Saenko

Generating engaging content has drawn much recent attention in the NLP community. Asking questions is a natural way to respond to photos and promote awareness. However, most answers to questions in traditional question-answering (QA)…

Computation and Language · Computer Science 2022-11-21 Min-Hsuan Yeh , Vicent Chen , Ting-Hao 'Kenneth' Haung , Lun-Wei Ku