English
Related papers

Related papers: Augmenting Visual Question Answering with Semantic…

200 papers

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Duong T. Tran , Trung-Kien Tran , Manfred Hauswirth , Danh Le Phuoc

In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this concept by adding…

Computation and Language · Computer Science 2024-06-17 Manas Jhalani , Annervaz K M , Pushpak Bhattacharyya

Visual Question Answering (VQA) models employ attention mechanisms to discover image locations that are most relevant for answering a specific question. For this purpose, several multimodal fusion strategies have been proposed, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Moshiur R Farazi , Salman H Khan , Nick Barnes

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Dustin Schwenk , Apoorv Khandelwal , Christopher Clark , Kenneth Marino , Roozbeh Mottaghi

Event-Level Video Question Answering (EVQA) requires complex reasoning across video events to obtain the visual information needed to provide optimal answers. However, despite significant progress in model performance, few studies have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Chenyang Lyu , Tianbo Ji , Yvette Graham , Jennifer Foster

Free-form and open-ended Visual Question Answering systems solve the problem of providing an accurate natural language answer to a question pertaining to an image. Current VQA systems do not evaluate if the posed question is relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Prakruthi Prabhakar , Nitish Kulkarni , Linghao Zhang

In visual question answering (VQA) context, users often pose ambiguous questions to visual language models (VLMs) due to varying expression habits. Existing research addresses such ambiguities primarily by rephrasing questions. These…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Pu Jian , Donglei Yu , Wen Yang , Shuo Ren , Jiajun Zhang

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

We present an empirical study of active learning for Visual Question Answering, where a deep VQA model selects informative question-image pairs from a pool and queries an oracle for answers to maximally improve its performance under a…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Xiao Lin , Devi Parikh

Video Question Answering is a challenging task, which requires the model to reason over multiple frames and understand the interaction between different objects to answer questions based on the context provided within the video, especially…

Artificial Intelligence · Computer Science 2024-07-31 Bhanu Prakash Reddy Guda , Tanmay Kulkarni , Adithya Sampath , Swarnashree Mysore Sathyendra

Visual Question Answering (VQA) is the task of answering natural-language questions about images. We introduce the novel problem of determining the relevance of questions to images in VQA. Current VQA models do not reason about whether a…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Arijit Ray , Gordon Christie , Mohit Bansal , Dhruv Batra , Devi Parikh

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Aditya Kane , V Manushree , Sahil Khose

One of the key issues of Visual Question Answering (VQA) is to reason with semantic clues in the visual content under the guidance of the question, how to model relational semantics still remains as a great challenge. To fully capture…

Multimedia · Computer Science 2019-08-22 Zhuoqian Yang , Zengchang Qin , Jing Yu , Yue Hu

Large Language Models (LLMs) demonstrate impressive reasoning ability and the maintenance of world knowledge not only in natural language tasks, but also in some vision-language tasks such as open-domain knowledge-based visual question…

Computation and Language · Computer Science 2024-06-11 Ziyue Wang , Chi Chen , Peng Li , Yang Liu

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while…

Signal Processing · Electrical Eng. & Systems 2021-12-15 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

Computation and Language · Computer Science 2020-06-05 Goonmeet Bajaj , Bortik Bandyopadhyay , Daniel Schmidt , Pranav Maneriker , Christopher Myers , Srinivasan Parthasarathy

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-30 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem

Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Christel Chappuis , Sylvain Lobry , Benjamin Kellenberger , Bertrand Le Saux , Devis Tuia

Video Question Answering (VideoQA) aims to answer natural language questions based on the given video, with prior work primarily focusing on identifying the duration of relevant segments, referred to as explicit visual evidence. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tieyuan Chen , Huabin Liu , Yi Wang , Chaofan Gan , Mingxi Lyu , Ziran Qin , Shijie Li , Liquan Shen , Junhui Hou , Zheng Wang , Weiyao Lin