中文
相关论文

相关论文: Augmenting Visual Question Answering with Semantic…

200 篇论文

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Duong T. Tran , Trung-Kien Tran , Manfred Hauswirth , Danh Le Phuoc

In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this concept by adding…

计算与语言 · 计算机科学 2024-06-17 Manas Jhalani , Annervaz K M , Pushpak Bhattacharyya

Visual Question Answering (VQA) models employ attention mechanisms to discover image locations that are most relevant for answering a specific question. For this purpose, several multimodal fusion strategies have been proposed, ranging from…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Moshiur R Farazi , Salman H Khan , Nick Barnes

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

音频与语音处理 · 电气工程与系统科学 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Dustin Schwenk , Apoorv Khandelwal , Christopher Clark , Kenneth Marino , Roozbeh Mottaghi

Event-Level Video Question Answering (EVQA) requires complex reasoning across video events to obtain the visual information needed to provide optimal answers. However, despite significant progress in model performance, few studies have…

计算机视觉与模式识别 · 计算机科学 2023-05-16 Chenyang Lyu , Tianbo Ji , Yvette Graham , Jennifer Foster

Free-form and open-ended Visual Question Answering systems solve the problem of providing an accurate natural language answer to a question pertaining to an image. Current VQA systems do not evaluate if the posed question is relevant to the…

计算机视觉与模式识别 · 计算机科学 2018-07-24 Prakruthi Prabhakar , Nitish Kulkarni , Linghao Zhang

In visual question answering (VQA) context, users often pose ambiguous questions to visual language models (VLMs) due to varying expression habits. Existing research addresses such ambiguities primarily by rephrasing questions. These…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Pu Jian , Donglei Yu , Wen Yang , Shuo Ren , Jiajun Zhang

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

We present an empirical study of active learning for Visual Question Answering, where a deep VQA model selects informative question-image pairs from a pool and queries an oracle for answers to maximally improve its performance under a…

计算机视觉与模式识别 · 计算机科学 2017-11-07 Xiao Lin , Devi Parikh

Video Question Answering is a challenging task, which requires the model to reason over multiple frames and understand the interaction between different objects to answer questions based on the context provided within the video, especially…

Visual Question Answering (VQA) is the task of answering natural-language questions about images. We introduce the novel problem of determining the relevance of questions to images in VQA. Current VQA models do not reason about whether a…

计算机视觉与模式识别 · 计算机科学 2016-09-27 Arijit Ray , Gordon Christie , Mohit Bansal , Dhruv Batra , Devi Parikh

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Aditya Kane , V Manushree , Sahil Khose

One of the key issues of Visual Question Answering (VQA) is to reason with semantic clues in the visual content under the guidance of the question, how to model relational semantics still remains as a great challenge. To fully capture…

多媒体 · 计算机科学 2019-08-22 Zhuoqian Yang , Zengchang Qin , Jing Yu , Yue Hu

Large Language Models (LLMs) demonstrate impressive reasoning ability and the maintenance of world knowledge not only in natural language tasks, but also in some vision-language tasks such as open-domain knowledge-based visual question…

计算与语言 · 计算机科学 2024-06-11 Ziyue Wang , Chi Chen , Peng Li , Yang Liu

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while…

信号处理 · 电气工程与系统科学 2021-12-15 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a…

计算机视觉与模式识别 · 计算机科学 2017-08-30 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem

Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate)…

计算机视觉与模式识别 · 计算机科学 2021-09-27 Christel Chappuis , Sylvain Lobry , Benjamin Kellenberger , Bertrand Le Saux , Devis Tuia

Video Question Answering (VideoQA) aims to answer natural language questions based on the given video, with prior work primarily focusing on identifying the duration of relevant segments, referred to as explicit visual evidence. However,…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Tieyuan Chen , Huabin Liu , Yi Wang , Chaofan Gan , Mingxi Lyu , Ziran Qin , Shijie Li , Liquan Shen , Junhui Hou , Zheng Wang , Weiyao Lin