中文
相关论文

相关论文: Question Type Guided Attention in Visual Question …

200 篇论文

Visual Question Answering (VQA) concerns providing answers to Natural Language questions about images. Several deep neural network approaches have been proposed to model the task in an end-to-end fashion. Whereas the task is grounded in…

人工智能 · 计算机科学 2020-02-03 Mehrdad Alizadeh , Barbara Di Eugenio

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Binh X. Nguyen , Tuong Do , Huy Tran , Erman Tjiputra , Quang D. Tran , Anh Nguyen

In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this concept by adding…

计算与语言 · 计算机科学 2024-06-17 Manas Jhalani , Annervaz K M , Pushpak Bhattacharyya

Visual question answering (or VQA) is a new and exciting problem that combines natural language processing and computer vision techniques. We present a survey of the various datasets and models that have been used to tackle this task. The…

计算与语言 · 计算机科学 2017-05-12 Akshay Kumar Gupta

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat

Visual Question Answering (VQA) is an increasingly popular topic in deep learning research, requiring coordination of natural language processing and computer vision modules into a single architecture. We build upon the model which placed…

计算与语言 · 计算机科学 2018-03-22 Jasdeep Singh , Vincent Ying , Alex Nutkiewicz

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

计算机视觉与模式识别 · 计算机科学 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel

Visual Question Answering (VQA) requires AI models to comprehend data in two domains, vision and text. Current state-of-the-art models use learned attention mechanisms to extract relevant information from the input domains to answer a…

人工智能 · 计算机科学 2019-03-27 Ahmed Osman , Wojciech Samek

Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating…

计算机视觉与模式识别 · 计算机科学 2020-01-07 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

计算机视觉与模式识别 · 计算机科学 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

Learning to answer visual questions is a challenging task since the multi-modal inputs are within two feature spaces. Moreover, reasoning in visual question answering requires the model to understand both image and question, and align them…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Peixi Xiong , Yilin Shen , Hongxia Jin

The use of complex attention modules has improved the performance of the Visual Question Answering (VQA) task. This work aims to learn an improved multi-modal representation through dense interaction of visual and textual modalities. The…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Aakansha Mishra , Ashish Anand , Prithwijit Guha

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

计算机视觉与模式识别 · 计算机科学 2017-09-15 Kushal Kafle , Christopher Kanan

Audio--Visual Question Answering (AVQA) is a challenging multimodal task that requires jointly reasoning over audio, visual, and textual information in a given video to answer natural language questions. Inspired by recent advances in Video…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Kun Li , Michael Ying Yang , Sami Sebastian Brandt

Visual Question Answering (VQA) has witnessed tremendous progress in recent years. However, most efforts only focus on the 2D image question answering tasks. In this paper, we present the first attempt at extending VQA to the 3D domain,…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Shuquan Ye , Dongdong Chen , Songfang Han , Jing Liao

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

计算机视觉与模式识别 · 计算机科学 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

计算机视觉与模式识别 · 计算机科学 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

计算机视觉与模式识别 · 计算机科学 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros

This paper proposes to improve visual question answering (VQA) with structured representations of both scene contents and questions. A key challenge in VQA is to require joint reasoning over the visual and text domains. The predominant…

计算机视觉与模式识别 · 计算机科学 2017-03-31 Damien Teney , Lingqiao Liu , Anton van den Hengel