中文
相关论文

相关论文: Dual Recurrent Attention Units for Visual Question…

200 篇论文

Existing attention mechanisms either attend to local image grid or object level features for Visual Question Answering (VQA). Motivated by the observation that questions can relate to both object instances and their parts, we propose a…

计算机视觉与模式识别 · 计算机科学 2021-08-30 Moshiur R Farazi , Salman H Khan

Visual Question Answering (VQA) is an increasingly popular topic in deep learning research, requiring coordination of natural language processing and computer vision modules into a single architecture. We build upon the model which placed…

计算与语言 · 计算机科学 2018-03-22 Jasdeep Singh , Vincent Ying , Alex Nutkiewicz

Visual Question Answering (VQA) models employ attention mechanisms to discover image locations that are most relevant for answering a specific question. For this purpose, several multimodal fusion strategies have been proposed, ranging from…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Moshiur R Farazi , Salman H Khan , Nick Barnes

We consider the problem of Visual Question Answering (VQA). Given an image and a free-form, open-ended, question, expressed in natural language, the goal of VQA system is to provide accurate answer to this question with respect to the…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Tanzila Rahman , Shih-Han Chou , Leonid Sigal , Giuseppe Carenini

Attention mechanisms have been widely used in Visual Question Answering (VQA) solutions due to their capacity to model deep cross-domain interactions. Analyzing attention maps offers us a perspective to find out limitations of current VQA…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Wei Li , Zehuan Yuan , Xiangzhong Fang , Changhu Wang

We propose a novel algorithm for visual question answering based on a recurrent deep neural network, where every module in the network corresponds to a complete answering unit with attention mechanism by itself. The network is optimized by…

计算机视觉与模式识别 · 计算机科学 2016-10-03 Hyeonwoo Noh , Bohyung Han

Visual dialog is a task of answering a series of inter-dependent questions given an input image, and often requires to resolve visual references among the questions. This problem is different from visual question answering (VQA), which…

计算机视觉与模式识别 · 计算机科学 2018-08-08 Paul Hongsuck Seo , Andreas Lehrmann , Bohyung Han , Leonid Sigal

This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge. VQA is a task of significant importance for research in artificial intelligence, given its multimodal…

计算机视觉与模式识别 · 计算机科学 2017-08-10 Damien Teney , Peter Anderson , Xiaodong He , Anton van den Hengel

Recently, attention-based Visual Question Answering (VQA) has achieved great success by utilizing question to selectively target different visual areas that are related to the answer. Existing visual attention models are generally planar,…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jingkuan Song , Pengpeng Zeng , Lianli Gao , Heng Tao Shen

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

A key solution to visual question answering (VQA) exists in how to fuse visual and language features extracted from an input image and question. We show that an attention mechanism that enables dense, bi-directional interactions between the…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

The current success of modern visual reasoning systems is arguably attributed to cross-modality attention mechanisms. However, in deliberative reasoning such as in VQA, attention is unconstrained at each step, and thus may serve as a…

计算机视觉与模式识别 · 计算机科学 2022-05-26 Thao Minh Le , Vuong Le , Sunil Gupta , Svetha Venkatesh , Truyen Tran

In recent years, multi-modal transformers have shown significant progress in Vision-Language tasks, such as Visual Question Answering (VQA), outperforming previous architectures by a considerable margin. This improvement in VQA is often…

计算机视觉与模式识别 · 计算机科学 2022-01-12 Ankur Sikarwar , Gabriel Kreiman

A number of recent works have proposed attention models for Visual Question Answering (VQA) that generate spatial maps highlighting image regions relevant to answering the question. In this paper, we argue that in addition to modeling…

计算机视觉与模式识别 · 计算机科学 2017-01-20 Jiasen Lu , Jianwei Yang , Dhruv Batra , Devi Parikh

Visual question answering (VQA) has witnessed great progress since May, 2015 as a classic problem unifying visual and textual data into a system. Many enlightening VQA works explore deep into the image and question encodings and fusing…

计算机视觉与模式识别 · 计算机科学 2017-02-23 Yuetan Lin , Zhangyang Pang , Donghui Wang , Yueting Zhuang

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

计算机视觉与模式识别 · 计算机科学 2016-03-22 Huijuan Xu , Kate Saenko
‹ 上一页 1 2 3 10 下一页 ›