中文
相关论文

相关论文: Semantic-aware Modular Capsule Routing for Visual …

200 篇论文

Current Visual Question Answering (VQA) systems can answer intelligent questions about `Known' visual content. However, their performance drops significantly when questions about visually and linguistically `Unknown' concepts are presented…

计算机视觉与模式识别 · 计算机科学 2018-12-03 Moshiur R Farazi , Salman H Khan , Nick Barnes

In this paper, we propose a method to obtain robust explanations for visual question answering(VQA) that correlate well with the answers. Our model explains the answers obtained through a VQA model by providing visual and textual…

计算机视觉与模式识别 · 计算机科学 2020-01-24 Badri N. Patro , Shivansh Pate , Vinay P. Namboodiri

Numerical reasoning skills are essential for complex question answering (CQA) over text. It requires opertaions including counting, comparison, addition and subtraction. A successful approach to CQA on text, Neural Module Networks (NMNs),…

计算与语言 · 计算机科学 2021-09-07 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

计算机视觉与模式识别 · 计算机科学 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of answering…

计算机视觉与模式识别 · 计算机科学 2017-12-05 Guohao Li , Hang Su , Wenwu Zhu

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

计算机视觉与模式识别 · 计算机科学 2017-11-23 Damien Teney , Anton van den Hengel

In this paper, we consider the problem of solving semantic tasks such as `Visual Question Answering' (VQA), where one aims to answers related to an image and `Visual Question Generation' (VQG), where one aims to generate a natural question…

计算机视觉与模式识别 · 计算机科学 2019-12-23 Badri N. Patro , Vinay P. Namboodiri

Visual question answering (VQA) requires joint comprehension of images and natural language questions, where many questions can't be directly or clearly answered from visual content but require reasoning from structured human knowledge with…

计算机视觉与模式识别 · 计算机科学 2018-06-14 Zhou Su , Chen Zhu , Yinpeng Dong , Dongqi Cai , Yurong Chen , Jianguo Li

Learning to reliably perceive and understand the scene is an integral enabler for robots to operate in the real-world. This problem is inherently challenging due to the multitude of object types as well as appearance changes caused by…

计算机视觉与模式识别 · 计算机科学 2021-11-05 Abhinav Valada , Rohit Mohan , Wolfram Burgard

Collaborative reasoning for understanding image-question pairs is a very critical but underexplored topic in interpretable visual question answering systems. Although very recent studies have attempted to use explicit compositional…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Qingxing Cao , Bailin Li , Xiaodan Liang , Liang Lin

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

Visual Question Answering (VQA) models often perform poorly on out-of-distribution data and struggle on domain generalization. Due to the multi-modal nature of this task, multiple factors of variation are intertwined, making generalization…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Zhuowan Li , Xingrui Wang , Elias Stengel-Eskin , Adam Kortylewski , Wufei Ma , Benjamin Van Durme , Alan Yuille

With the new generation of satellite technologies, the archives of remote sensing (RS) images are growing very fast. To make the intrinsic information of each RS image easily accessible, visual question answering (VQA) has been introduced…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Tim Siebert , Kai Norman Clasen , Mahdyar Ravanbakhsh , Begüm Demir

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

计算机视觉与模式识别 · 计算机科学 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

Deep neural networks have been playing an essential role in many computer vision tasks including Visual Question Answering (VQA). Until recently, the study of their accuracy was the main focus of research but now there is a trend toward…

计算机视觉与模式识别 · 计算机科学 2018-12-27 Jia-Hong Huang , Cuong Duc Dao , Modar Alfadly , Bernard Ghanem

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Multimodal attentional networks are currently state-of-the-art models for Visual Question Answering (VQA) tasks involving real images. Although attention allows to focus on the visual content relevant to the question, this simple mechanism…

计算机视觉与模式识别 · 计算机科学 2019-02-26 Remi Cadene , Hedi Ben-younes , Matthieu Cord , Nicolas Thome