English
Related papers

Related papers: Roses Are Red, Violets Are Blue... but Should Vqa …

200 papers

Since its inception, Visual Question Answering (VQA) is notoriously known as a task, where models are prone to exploit biases in datasets to find shortcuts instead of performing high-level reasoning. Classical methods address this by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Corentin Kervadec , Theo Jaunet , Grigory Antipov , Moez Baccouche , Romain Vuillemot , Christian Wolf

Visual Question Answering (VQA) models are prone to learn the shortcut solution formed by dataset biases rather than the intended solution. To evaluate the VQA models' reasoning ability beyond shortcut learning, the VQA-CP v2 dataset…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Qingyi Si , Fandong Meng , Mingyu Zheng , Zheng Lin , Yuanxin Liu , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou

Vision-and-language tasks have increasingly drawn more attention as a means to evaluate human-like reasoning in machine learning models. A popular task in the field is visual question answering (VQA), which aims to answer questions about…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Yusuke Hirota , Yuta Nakashima , Noa Garcia

Visual question answering (VQA) is the multi-modal task of answering natural language questions about an input image. Through cross-dataset adaptation methods, it is possible to transfer knowledge from a source dataset with larger train…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Arjun R. Akula

A number of studies have found that today's Visual Question Answering (VQA) models are heavily driven by superficial correlations in the training data and lack sufficient image grounding. To encourage development of models geared towards…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh , Aniruddha Kembhavi

Visual Question Answering (VQA) research is split into two camps: the first focuses on VQA datasets that require natural image understanding and the second focuses on synthetic datasets that test reasoning. A good VQA algorithm should be…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Robik Shrestha , Kushal Kafle , Christopher Kanan

We introduce an evaluation methodology for visual question answering (VQA) to better diagnose cases of shortcut learning. These cases happen when a model exploits spurious statistical regularities to produce correct answers but does not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Corentin Dancette , Remi Cadene , Damien Teney , Matthieu Cord

We introduce a new test set for visual question answering (VQA) called BinaryVQA to push the limits of VQA models. Our dataset includes 7,800 questions across 1,024 images and covers a wide variety of objects, topics, and concepts. For easy…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Ali Borji

GQA~\citep{hudson2019gqa} is a dataset for real-world visual reasoning and compositional question answering. We found that many answers predicted by the best vision-language models on the GQA dataset do not match the ground-truth answer but…

Computation and Language · Computer Science 2022-06-02 Man Luo , Shailaja Keyur Sampat , Riley Tallman , Yankai Zeng , Manuha Vancha , Akarshan Sajja , Chitta Baral

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Damien Teney , Anton van den Hengel

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yeyun Zou , Qiyu Xie

Deep Neural Networks have been successfully used for the task of Visual Question Answering for the past few years owing to the availability of relevant large scale datasets. However these datasets are created in artificial settings and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Shaunak Halbe

Visual Question Answering (VQA) has emerged as a Visual Turing Test to validate the reasoning ability of AI agents. The pivot to existing VQA models is the joint embedding that is learned by combining the visual features from an image and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Moshiur R. Farazi , Salman H. Khan , Nick Barnes

Visual question answering (or VQA) is a new and exciting problem that combines natural language processing and computer vision techniques. We present a survey of the various datasets and models that have been used to tackle this task. The…

Computation and Language · Computer Science 2017-05-12 Akshay Kumar Gupta

Visual question answering (VQA) models respond to open-ended natural language questions about images. While VQA is an increasingly popular area of research, it is unclear to what extent current VQA architectures learn key semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Gabriel Grand , Aron Szanto , Yoon Kim , Alexander Rush

Vision-and-language (V&L) models pretrained on large-scale multimodal data have demonstrated strong performance on various tasks such as image captioning and visual question answering (VQA). The quality of such models is commonly assessed…

Computation and Language · Computer Science 2023-04-04 Aishwarya Agrawal , Ivana Kajić , Emanuele Bugliarello , Elnaz Davoodi , Anita Gergely , Phil Blunsom , Aida Nematzadeh
‹ Prev 1 2 3 10 Next ›