English
Related papers

Related papers: Visual Question Answering: which investigated appl…

200 papers

Visual Question Answering is a multi-modal task that aims to measure high-level visual understanding. Contemporary VQA models are restrictive in the sense that answers are obtained via classification over a limited vocabulary (in the case…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Radhika Dua , Sai Srinivas Kancheti , Vineeth N Balasubramanian

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

Computation and Language · Computer Science 2019-07-12 Drew A. Hudson , Christopher D. Manning

We present an empirical study of active learning for Visual Question Answering, where a deep VQA model selects informative question-image pairs from a pool and queries an oracle for answers to maximally improve its performance under a…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Xiao Lin , Devi Parikh

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

Artificial Intelligence · Computer Science 2016-08-30 Danna Gurari , Kristen Grauman

Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Christel Chappuis , Sylvain Lobry , Benjamin Kellenberger , Bertrand Le Saux , Devis Tuia

We propose a method for visual question answering which combines an internal representation of the content of an image with information extracted from a general knowledge base to answer a broad range of image-based questions. This allows…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Qi Wu , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

Video quality assessment (VQA) is an important processing task, aiming at predicting the quality of videos in a manner highly consistent with human judgments of perceived quality. Traditional VQA models based on natural image and/or video…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Qi Zheng , Yibo Fan , Leilei Huang , Tianyu Zhu , Jiaming Liu , Zhijian Hao , Shuo Xing , Chia-Ju Chen , Xiongkuo Min , Alan C. Bovik , Zhengzhong Tu

Logical connectives and their implications on the meaning of a natural language sentence are a fundamental aspect of understanding. In this paper, we investigate whether visual question answering (VQA) systems trained to answer a question…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Tejas Gokhale , Pratyay Banerjee , Chitta Baral , Yezhou Yang

In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos. The problem requires comprehensive multimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Guangyao Li , Yake Wei , Yapeng Tian , Chenliang Xu , Ji-Rong Wen , Di Hu

In recent years, people have increasingly used AI to help them with their problems by asking questions on different topics. One of these topics can be software-related and programming questions. In this work, we focus on the questions which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Motahhare Mirzaei , Mohammad Javad Pirhadi , Sauleh Eetemadi

Question answering (QA) systems are among the most important and rapidly developing research topics in natural language processing (NLP). A reason, therefore, is that a QA system allows humans to interact more naturally with a machine,…

Computation and Language · Computer Science 2022-09-27 Amer Farea , Zhen Yang , Kien Duong , Nadeesha Perera , Frank Emmert-Streib

Most existing works in visual question answering (VQA) are dedicated to improving the accuracy of predicted answers, while disregarding the explanations. We argue that the explanation for an answer is of the same or even more importance…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Qing Li , Qingyi Tao , Shafiq Joty , Jianfei Cai , Jiebo Luo

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

As in many tasks combining vision and language, both modalities play a crucial role in Visual Question Answering (VQA). To properly solve the task, a given model should both understand the content of the proposed image and the nature of the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Pierre Marza , Corentin Kervadec , Grigory Antipov , Moez Baccouche , Christian Wolf

Visual question answering is a task of predicting the answer to a question about an image. Given that different people can provide different answers to a visual question, we aim to better understand why with answer groundings. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Chongyan Chen , Samreen Anjum , Danna Gurari

Visual Question Answering (VQA) benchmarks have largely emphasized perception-based tasks that can be solved from visual content alone. In contrast, many real-world scenarios require external knowledge that is not directly observable in the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Basel Shbita , Pengyuan Li , Anna Lisa Gentile

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

Machine Learning · Computer Science 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida

A number of studies have found that today's Visual Question Answering (VQA) models are heavily driven by superficial correlations in the training data and lack sufficient image grounding. To encourage development of models geared towards…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh , Aniruddha Kembhavi