English
Related papers

Related papers: Ask Questions with Double Hints: Visual Question G…

200 papers

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Huijuan Xu , Kate Saenko

Visual Question Generation (VQG) research focuses predominantly on natural images while neglecting the diagram, which is a critical component in educational materials. To meet the needs of pedagogical assessment, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Xinyu Zhang , Lingling Zhang , Yanrui Wu , Muye Huang , Wenjun Wu , Bo Li , Shaowei Wang , Basura Fernando , Jun Liu

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Jialin Wu , Raymond J. Mooney

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Damien Teney , Anton van den Hengel

Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Visual question answering (VQA) is a challenging task to provide an accurate natural language answer given an image and a natural language question about the image. It involves multi-modal learning, i.e., computer vision (CV) and natural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Luoqian Jiang , Yifan He , Jian Chen

Answering visual questions need acquire daily common knowledge and model the semantic connection among different parts in images, which is too difficult for VQA systems to learn from images with the only supervision from answers. Meanwhile,…

Computation and Language · Computer Science 2018-05-23 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Supriya Pandhre , Shagun Sodhani

Methods for teaching machines to answer visual questions have made significant progress in recent years, but current methods still lack important human capabilities, including integrating new visual classes and concepts in a modular manner,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Ben-Zion Vatashsky , Shimon Ullman

Generating natural questions from an image is a semantic task that requires using vision and language modalities to learn multimodal representations. Images can have multiple visual and language cues such as places, captions, and tags. In…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Badri N. Patro , Vinod K. Kurmi , Sandeep Kumar , Vinay P. Namboodiri

The ability to ask questions is a powerful tool to gather information in order to learn about the world and resolve ambiguities. In this paper, we explore a novel problem of generating discriminative questions to help disambiguate visual…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Yining Li , Chen Huang , Xiaoou Tang , Chen-Change Loy

Medical visual question answering (VQA) aims to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficiency of medical professionals while relieving the burden on the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xinyue Hu , Lin Gu , Kazuma Kobayashi , Qiyuan An , Qingyu Chen , Zhiyong Lu , Chang Su , Tatsuya Harada , Yingying Zhu

Vision and language understanding has emerged as a subject undergoing intense study in Artificial Intelligence. Among many tasks in this line of research, visual question answering (VQA) has been one of the most successful ones, where the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Yunseok Jang , Yale Song , Youngjae Yu , Youngjin Kim , Gunhee Kim

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat

Natural language is ambiguous. Resolving ambiguous questions is key to successfully answering them. Focusing on questions about images, we create a dataset of ambiguous examples. We annotate these, grouping answers by the underlying…

Computation and Language · Computer Science 2023-06-05 Elias Stengel-Eskin , Jimena Guallar-Blasco , Yi Zhou , Benjamin Van Durme

We propose a method for visual question answering which combines an internal representation of the content of an image with information extracted from a general knowledge base to answer a broad range of image-based questions. This allows…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Qi Wu , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Growing interest in conversational agents promote twoway human-computer communications involving asking and answering visual questions have become an active area of research in AI. Thus, generation of visual questionanswer pair(s) becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Charani Alampalle , Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic…

Computation and Language · Computer Science 2024-08-23 Taehee Kim , Yeongjae Cho , Heejun Shin , Yohan Jo , Dongmyung Shin

Generating natural questions from an image is a semantic task that requires using visual and language modality to learn multimodal representations. Images can have multiple visual and language contexts that are relevant for generating…

Computation and Language · Computer Science 2019-10-18 Badri N. Patro , Sandeep Kumar , Vinod K. Kurmi , Vinay P. Namboodiri