English
Related papers

Related papers: Graph-Structured Representations for Visual Questi…

200 papers

Visual Question Answering (VQA) has emerged as a highly engaging field in recent years, with increasing research focused on enhancing VQA accuracy through advanced models such as Transformers. Despite this growing interest, limited work has…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Zhilin Zhang , Fangyu Wu

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

Computation and Language · Computer Science 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic…

Computation and Language · Computer Science 2024-08-23 Taehee Kim , Yeongjae Cho , Heejun Shin , Yohan Jo , Dongmyung Shin

Multimodal reasoning models often produce fluent answers supported by seemingly coherent rationales. Existing benchmarks evaluate only final-answer correctness. They do not support atomic visual entailment verification of intermediate…

Artificial Intelligence · Computer Science 2026-03-25 Saleem Ahmed , Srirangaraj Setlur , Venu Govindaraju

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

Visual Question Answering (VQA) has emerged as one of the most challenging tasks in artificial intelligence due to its multi-modal nature. However, most existing VQA methods are incapable of handling Knowledge-based Visual Question…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Chengxiang Yin , Zhengping Che , Kun Wu , Zhiyuan Xu , Jian Tang

While vision-language models (VLMs) excel at tasks involving single images or short videos, they still struggle with Long Video Question Answering (LVQA) due to its demand for complex multi-step temporal reasoning. Vanilla approaches, which…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sahil Shah , S P Sharan , Harsh Goel , Minkyu Choi , Mustafa Munir , Manvik Pasula , Radu Marculescu , Sandeep Chinchali

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Video question answering is a challenging task, which requires agents to be able to understand rich video contents and perform spatial-temporal reasoning. However, existing graph-based methods fail to perform multi-step reasoning well,…

Multimedia · Computer Science 2021-07-14 Jianyu Wang , Bing-Kun Bao , Changsheng Xu

Question-Answering (QA) from technical documents often involves questions whose answers are present in figures, such as flowcharts or flow diagrams. Text-based Retrieval Augmented Generation (RAG) systems may fail to answer such questions.…

Computation and Language · Computer Science 2025-08-01 Sumit Soman , H. G. Ranjani , Sujoy Roychowdhury , Venkata Dharma Surya Narayana Sastry , Akshat Jain , Pranav Gangrade , Ayaaz Khan

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Visual Question Answering (VQA) focuses on providing answers to natural language questions by utilizing information from images. Although cutting-edge multimodal large language models (MLLMs) such as GPT-4o achieve strong performance on VQA…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Zhengxuan Zhang , Yin Wu , Yuyu Luo , Nan Tang

Large Vision-Language Models (LVLMs) achieve strong performance on visual question answering benchmarks, yet often rely on spurious correlations rather than genuine causal reasoning. Existing evaluations primarily assess the correctness of…

Artificial Intelligence · Computer Science 2026-02-25 Dhita Putri Pratama , Soyeon Caren Han , Yihao Ding

The main challenge in video question answering (VideoQA) is to capture and understand the complex spatial and temporal relations between objects based on given questions. Existing graph-based methods for VideoQA usually ignore keywords in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yi Cheng , Hehe Fan , Dongyun Lin , Ying Sun , Mohan Kankanhalli , Joo-Hwee Lim

We study how vision-language models (VLMs) trained on web-scale data can be integrated into end-to-end driving systems to boost generalization and enable interactivity with human users. While recent approaches adapt VLMs to driving via…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Chonghao Sima , Katrin Renz , Kashyap Chitta , Li Chen , Hanxue Zhang , Chengen Xie , Jens Beißwenger , Ping Luo , Andreas Geiger , Hongyang Li

Vision-Language Models (VLMs) have transformed tasks requiring visual and reasoning abilities, such as image retrieval and Visual Question Answering (VQA). Despite their success, VLMs face significant challenges with tasks involving…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Ayush Singh , Mansi Gupta , Shivank Garg , Abhinav Kumar , Vansh Agrawal

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

Video-Question-Answering (VideoQA) comprises the capturing of complex visual relation changes over time, remaining a challenge even for advanced Video Language Models (VLM), i.a., because of the need to represent the visual content to a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Sofian Chaybouti , Walid Bousselham , Moritz Wolter , Hilde Kuehne

Humans explain inter-object relationships with semantic labels that demonstrate a high-level understanding required to perform complex Vision-Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Moshiur Farazi , Salman Khan , Nick Barnes