中文
相关论文

相关论文: Visual Query Answering by Entity-Attribute Graph M…

200 篇论文

The large success of deep learning based methods in Visual Question Answering (VQA) has concurrently increased the demand for explainable methods. Most methods in Explainable Artificial Intelligence (XAI) focus on generating post-hoc…

计算与语言 · 计算机科学 2024-03-28 Pascal Tilli , Ngoc Thang Vu

Visual question answering is a task of predicting the answer to a question about an image. Given that different people can provide different answers to a visual question, we aim to better understand why with answer groundings. We introduce…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Chongyan Chen , Samreen Anjum , Danna Gurari

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Existing Visual Question Answering (VQA) models have explored various visual relationships between objects in the image to answer complex questions, which inevitably introduces irrelevant information brought by inaccurate object detection…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Yuxi Qian , Yuncong Hu , Ruonan Wang , Fangxiang Feng , Xiaojie Wang

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

计算与语言 · 计算机科学 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

The ideal form of Visual Question Answering requires understanding, grounding and reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most existing VQA benchmarks are…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Kang Chen , Xiangqian Wu

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

计算机视觉与模式识别 · 计算机科学 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

Visual question answering (VQA) has been gaining a lot of traction in the machine learning community in the recent years due to the challenges posed in understanding information coming from multiple modalities (i.e., images, language). In…

计算机视觉与模式识别 · 计算机科学 2021-11-11 Muralikrishnna G. Sethuraman , Ali Payani , Faramarz Fekri , J. Clayton Kerce

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

计算与语言 · 计算机科学 2019-07-12 Drew A. Hudson , Christopher D. Manning

Visual Question Answering (VQA) is a novel problem domain where multi-modal inputs must be processed in order to solve the task given in the form of a natural language. As the solutions inherently require to combine visual and natural…

计算机视觉与模式识别 · 计算机科学 2018-01-31 Mikyas T. Desta , Larry Chen , Tomasz Kornuta

Accurately answering a question about a given image requires combining observations with general knowledge. While this is effortless for humans, reasoning with general knowledge remains an algorithmic challenge. To advance research in this…

计算机视觉与模式识别 · 计算机科学 2018-11-02 Medhini Narasimhan , Svetlana Lazebnik , Alexander G. Schwing

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

计算机视觉与模式识别 · 计算机科学 2017-09-26 Supriya Pandhre , Shagun Sodhani

The intersection of vision and language is of major interest due to the increased focus on seamless integration between recognition and reasoning. Scene graphs (SGs) have emerged as a useful tool for multimodal image analysis, showing…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Bruno Souza , Marius Aasan , Helio Pedrini , Adín Ramírez Rivera

Infographics are documents designed to effectively communicate information using a combination of textual, graphical and visual elements. In this work, we explore the automatic understanding of infographic images by using Visual Question…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Minesh Mathew , Viraj Bagal , Rubèn Pérez Tito , Dimosthenis Karatzas , Ernest Valveny , C. V Jawahar

Modeling visual question answering(VQA) through scene graphs can significantly improve the reasoning accuracy and interpretability. However, existing models answer poorly for complex reasoning questions with attributes or relations, which…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Hao Li , Xu Li , Belhal Karimi , Jie Chen , Mingming Sun

Visual Question Answering is a multi-modal task that aims to measure high-level visual understanding. Contemporary VQA models are restrictive in the sense that answers are obtained via classification over a limited vocabulary (in the case…

计算机视觉与模式识别 · 计算机科学 2021-06-18 Radhika Dua , Sai Srinivas Kancheti , Vineeth N Balasubramanian

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Visual question answering (VQA) is a Multidisciplinary research problem that pursued through practices of natural language processing and computer vision. Visual question answering automatically answers natural language questions according…

计算机视觉与模式识别 · 计算机科学 2024-09-01 Param Ahir , Hiteishi Diwanji

Recently, Visual Question Answering (VQA) has emerged as one of the most significant tasks in multimodal learning as it requires understanding both visual and textual modalities. Existing methods mainly rely on extracting image and question…

计算机视觉与模式识别 · 计算机科学 2018-07-23 Pan Lu , Lei Ji , Wei Zhang , Nan Duan , Ming Zhou , Jianyong Wang