中文
相关论文

相关论文: The VQA-Machine: Learning How to Use Existing Visi…

200 篇论文

Knowledge-based Visual Question Answering (VQA) expects models to rely on external knowledge for robust answer prediction. Though significant it is, this paper discovers several leading factors impeding the advancement of current…

计算机视觉与模式识别 · 计算机科学 2022-07-01 Yangyang Guo , Liqiang Nie , Yongkang Wong , Yibing Liu , Zhiyong Cheng , Mohan Kankanhalli

Video Question Answering (VQA) is a recent emerging challenging task in the field of Computer Vision. Several visual information retrieval techniques like Video Captioning/Description and Video-guided Machine Translation have preceded the…

计算机视觉与模式识别 · 计算机科学 2021-03-19 Devshree Patel , Ratnam Parikh , Yesha Shastri

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

计算机视觉与模式识别 · 计算机科学 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

计算机视觉与模式识别 · 计算机科学 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

The task of Outside Knowledge Visual Question Answering (OKVQA) requires an automatic system to answer natural language questions about pictures and images using external knowledge. We observe that many visual questions, which contain…

人工智能 · 计算机科学 2022-02-10 Jiawen Zhang , Abhijit Mishra , Avinesh P. V. S , Siddharth Patwardhan , Sachin Agarwal

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

Visual Question Answering (VQA) models aim to answer natural language questions about given images. Due to its ability to ask questions that differ from those used when training the model, medical VQA has received substantial attention in…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Questions that require counting a variety of objects in images remain a major challenge in visual question answering (VQA). The most common approaches to VQA involve either classifying answers based on fixed length representations of both…

人工智能 · 计算机科学 2018-03-05 Alexander Trott , Caiming Xiong , Richard Socher

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Binh X. Nguyen , Tuong Do , Huy Tran , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Visual Question Answering (VQA) has benefited from increasingly sophisticated models, but has not enjoyed the same level of engagement in terms of data creation. In this paper, we propose a method that automatically derives VQA examples at…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Soravit Changpinyo , Doron Kukliansky , Idan Szpektor , Xi Chen , Nan Ding , Radu Soricut

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

人工智能 · 计算机科学 2016-08-30 Danna Gurari , Kristen Grauman

A number of studies have found that today's Visual Question Answering (VQA) models are heavily driven by superficial correlations in the training data and lack sufficient image grounding. To encourage development of models geared towards…

计算机视觉与模式识别 · 计算机科学 2018-06-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh , Aniruddha Kembhavi

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Teaching Visual Question Answering (VQA) models to refrain from answering unanswerable questions is necessary for building a trustworthy AI system. Existing studies, though have explored various aspects of VQA but somewhat ignored this…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Yangyang Guo , Fangkai Jiao , Zhiqi Shen , Liqiang Nie , Mohan Kankanhalli

Recently, attention-based Visual Question Answering (VQA) has achieved great success by utilizing question to selectively target different visual areas that are related to the answer. Existing visual attention models are generally planar,…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jingkuan Song , Pengpeng Zeng , Lianli Gao , Heng Tao Shen

Visual question answering (Visual QA) has attracted a lot of attention lately, seen essentially as a form of (visual) Turing test that artificial intelligence should strive to achieve. In this paper, we study a crucial component of this…

计算与语言 · 计算机科学 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha

Visual question answering (VQA) is challenging not only because the model has to handle multi-modal information, but also because it is just so hard to collect sufficient training examples -- there are too many questions one can ask about…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Jihyung Kil , Cheng Zhang , Dong Xuan , Wei-Lun Chao

Incorporating external knowledge to Visual Question Answering (VQA) has become a vital practical need. Existing methods mostly adopt pipeline approaches with different components for knowledge matching and extraction, feature learning,…

人工智能 · 计算机科学 2021-10-19 Zhuo Chen , Jiaoyan Chen , Yuxia Geng , Jeff Z. Pan , Zonggang Yuan , Huajun Chen

Visual Question Answering is a multi-modal task that aims to measure high-level visual understanding. Contemporary VQA models are restrictive in the sense that answers are obtained via classification over a limited vocabulary (in the case…

计算机视觉与模式识别 · 计算机科学 2021-06-18 Radhika Dua , Sai Srinivas Kancheti , Vineeth N Balasubramanian