English
Related papers

Related papers: RUBi: Reducing Unimodal Biases in Visual Question …

200 papers

Despite remarkable progress in recent years, Vision Language Models (VLMs) remain prone to overconfidence and hallucinations on tasks such as Visual Question Answering (VQA) and Visual Reasoning. Bayesian methods can potentially improve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Tobias Jan Wieczorek , Nathalie Daun , Mohammad Emtiyaz Khan , Marcus Rohrbach

Existing attention mechanisms either attend to local image grid or object level features for Visual Question Answering (VQA). Motivated by the observation that questions can relate to both object instances and their parts, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Moshiur R Farazi , Salman H Khan

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

Visual question answering (VQA) for remote sensing scene has great potential in intelligent human-computer interaction system. Although VQA in computer vision has been widely researched, VQA for remote sensing data (RSVQA) is still in its…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Zhenghang Yuan , Lichao Mou , Qi Wang , Xiao Xiang Zhu

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Generalization beyond in-domain experience to out-of-distribution data is of paramount significance in the AI domain. Of late, state-of-the-art Visual Question Answering (VQA) models have shown impressive performance on in-domain data,…

Artificial Intelligence · Computer Science 2023-09-06 Daowan Peng , Wei Wei , Xian-Ling Mao , Yuanyuan Fu , Dangyang Chen

Despite considerable recent progress in Visual Question Answering (VQA) models, inconsistent or contradictory answers continue to cast doubt on their true reasoning capabilities. However, most proposed methods use indirect strategies or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Visual Question Answering (VQA) has been a widely studied topic, with extensive research focusing on how VLMs respond to answerable questions based on real-world images. However, there has been limited exploration of how these models handle…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Asir Saadat , Syem Aziz , Shahriar Mahmud , Abdullah Ibne Masud Mahi , Sabbir Ahmed

This paper introduces speech-based visual question answering (VQA), the task of generating an answer given an image and a spoken question. Two methods are studied: an end-to-end, deep neural network that directly uses audio waveforms as…

Computation and Language · Computer Science 2017-09-19 Ted Zhang , Dengxin Dai , Tinne Tuytelaars , Marie-Francine Moens , Luc Van Gool

In question-answering scenarios, humans can assess whether the available information is sufficient and seek additional information if necessary, rather than providing a forced answer. In contrast, Vision Language Models (VLMs) typically…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Li Liu , Diji Yang , Sijia Zhong , Kalyana Suma Sree Tholeti , Lei Ding , Yi Zhang , Leilani H. Gilpin

Typical active learning strategies are designed for tasks, such as classification, with the assumption that the output space is mutually exclusive. The assumption that these tasks always have exactly one correct answer has resulted in the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Khaled Jedoui , Ranjay Krishna , Michael Bernstein , Li Fei-Fei

Visual question answering (VQA) is known as an AI-complete task as it requires understanding, reasoning, and inferring about the vision and the language content. Over the past few years, numerous neural architectures have been suggested for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Övgü Özdemir , Erdem Akagündüz

Machine Interpreting systems are currently implemented as unimodal, real-time speech-to-speech architectures, processing translation exclusively on the basis of the linguistic signal. Such reliance on a single modality, however, constrains…

Computation and Language · Computer Science 2025-09-30 Claudio Fantinuoli

Most Visual Question Answering (VQA) models suffer from the language prior problem, which is caused by inherent data biases. Specifically, VQA models tend to answer questions (e.g., what color is the banana?) based on the high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Xi Zhu , Zhendong Mao , Chunxiao Liu , Peng Zhang , Bin Wang , Yongdong Zhang

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

Computation and Language · Computer Science 2019-07-12 Drew A. Hudson , Christopher D. Manning

Visual Question Answering (VQA) presents a unique challenge by requiring models to understand and reason about visual content to answer questions accurately. Existing VQA models often struggle with biases introduced by the training data,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Zhifei Li , Feng Qiu , Yiran Wang , Yujing Xia , Kui Xiao , Miao Zhang , Yan Zhang

The field of visual question answering (VQA) has recently seen a surge in research focused on providing explanations for predicted answers. However, current systems mostly rely on separate models to predict answers and generate…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Tillman Weyde , Pranava Madhyastha

Programming based approaches to reasoning tasks have substantially expanded the types of questions models can answer about visual scenes. Yet on benchmark visual reasoning data, when models answer correctly, they produce incorrect programs…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Artemis Panagopoulou , Honglu Zhou , Silvio Savarese , Caiming Xiong , Chris Callison-Burch , Mark Yatskar , Juan Carlos Niebles

Recently, attention-based Visual Question Answering (VQA) has achieved great success by utilizing question to selectively target different visual areas that are related to the answer. Existing visual attention models are generally planar,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jingkuan Song , Pengpeng Zeng , Lianli Gao , Heng Tao Shen

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Aditya Kane , V Manushree , Sahil Khose