English
Related papers

Related papers: Multi-Clue Reasoning with Memory Augmentation for …

200 papers

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Huijuan Xu , Kate Saenko

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

Machine Learning · Computer Science 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida

Generating natural questions from an image is a semantic task that requires using vision and language modalities to learn multimodal representations. Images can have multiple visual and language cues such as places, captions, and tags. In…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Badri N. Patro , Vinod K. Kurmi , Sandeep Kumar , Vinay P. Namboodiri

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

One of the most intriguing features of the Visual Question Answering (VQA) challenge is the unpredictability of the questions. Extracting the information required to answer them demands a variety of image operations from detection and…

Computer Vision and Pattern Recognition · Computer Science 2016-12-19 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel

Problems at the intersection of language and vision, like visual question answering, have recently been gaining a lot of attention in the field of multi-modal machine learning as computer vision research moves beyond traditional recognition…

Computation and Language · Computer Science 2018-09-25 Khyathi Raghavi Chandu , Mary Arpita Pyreddy , Matthieu Felix , Narendra Nath Joshi

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

Humans explain inter-object relationships with semantic labels that demonstrate a high-level understanding required to perform complex Vision-Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Moshiur Farazi , Salman Khan , Nick Barnes

We propose a novel probabilistic model for visual question answering (Visual QA). The key idea is to infer two sets of embeddings: one for the image and the question jointly and the other for the answers. The learning objective is to learn…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Hexiang Hu , Wei-Lun Chao , Fei Sha

Many vision and language tasks require commonsense reasoning beyond data-driven image and natural language processing. Here we adopt Visual Question Answering (VQA) as an example task, where a system is expected to answer a question in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Somak Aditya , Yezhou Yang , Chitta Baral

Medical Visual Question Answering (MedVQA) enables natural language queries over medical images to support clinical decision-making and patient care. The MEDIQA-WV 2025 shared task addressed wound-care VQA, requiring systems to generate…

Computation and Language · Computer Science 2025-10-17 A H M Rezaul Karim , Ozlem Uzuner

Integrating outside knowledge for reasoning in visio-linguistic tasks such as visual question answering (VQA) is an open problem. Given that pretrained language models have been shown to include world knowledge, we propose to use a unimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Ander Salaberria , Gorka Azkune , Oier Lopez de Lacalle , Aitor Soroa , Eneko Agirre

Machine comprehension(MC) style question answering is a representative problem in natural language processing. Previous methods rarely spend time on the improvement of encoding layer, especially the embedding of syntactic information and…

Artificial Intelligence · Computer Science 2017-07-31 Boyuan Pan , Hao Li , Zhou Zhao , Bin Cao , Deng Cai , Xiaofei He

The inherent difficulty of knowledge specification and the lack of trained specialists are some of the key obstacles on the way to making intelligent systems based on the knowledge representation and reasoning (KRR) paradigm commonplace.…

Computation and Language · Computer Science 2020-02-19 Tiantian Gao , Paul Fodor , Michael Kifer

In this research, we deal with the problem of visual question answering (VQA) in remote sensing. While remotely sensed images contain information significant for the task of identification and object detection, they pose a great challenge…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jayesh Songara , Shivam Pande , Shabnam Choudhury , Biplab Banerjee , Rajbabu Velmurugan

Knowledge-based visual question answering (KB-VQA) demonstrates significant potential for handling knowledge-intensive tasks. However, conflicts arise between static parametric knowledge in vision language models (VLMs) and dynamically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yuyang Hong , Jiaqi Gu , Yujin Lou , Lubin Fan , Qi Yang , Ying Wang , Kun Ding , Yue Wu , Shiming Xiang , Jieping Ye

Neural network architectures with memory and attention mechanisms exhibit certain reasoning capabilities required for question answering. One such architecture, the dynamic memory network (DMN), obtained high accuracy on a variety of…

Neural and Evolutionary Computing · Computer Science 2016-03-07 Caiming Xiong , Stephen Merity , Richard Socher

This work aims to address the problem of image-based question-answering (QA) with new models and datasets. In our work, we propose to use neural networks and visual semantic embeddings, without intermediate stages such as object detection…

Machine Learning · Computer Science 2015-12-01 Mengye Ren , Ryan Kiros , Richard Zemel

Medical visual question answering (VQA) aims to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficiency of medical professionals while relieving the burden on the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xinyue Hu , Lin Gu , Kazuma Kobayashi , Qiyuan An , Qingyu Chen , Zhiyong Lu , Chang Su , Tatsuya Harada , Yingying Zhu