English
Related papers

Related papers: Toward Unsupervised Realistic Visual Question Answ…

200 papers

One of the most intriguing features of the Visual Question Answering (VQA) challenge is the unpredictability of the questions. Extracting the information required to answer them demands a variety of image operations from detection and…

Computer Vision and Pattern Recognition · Computer Science 2016-12-19 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel

The widely used Fact-based Visual Question Answering (FVQA) dataset contains visually-grounded questions that require information retrieval using common sense knowledge graphs to answer. It has been observed that the original dataset is…

Computation and Language · Computer Science 2023-03-21 Weizhe Lin , Zhilin Wang , Bill Byrne

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Kushal Kafle , Christopher Kanan

The ideal form of Visual Question Answering requires understanding, grounding and reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most existing VQA benchmarks are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Kang Chen , Xiangqian Wu

Though beneficial for encouraging the Visual Question Answering (VQA) models to discover the underlying knowledge by exploiting the input-output correlation beyond image and text contexts, the existing knowledge VQA datasets are mostly…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Qingxing Cao , Bailin Li , Xiaodan Liang , Keze Wang , Liang Lin

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

We propose the inverse problem of Visual question answering (iVQA), and explore its suitability as a benchmark for visuo-linguistic understanding. The iVQA task is to generate a question that corresponds to a given image and answer pair.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

Computation and Language · Computer Science 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti

Visual Question Answering (VQA) is a recent problem in computer vision and natural language processing that has garnered a large amount of interest from the deep learning, computer vision, and natural language processing communities. In…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Kushal Kafle , Christopher Kanan

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Duong T. Tran , Trung-Kien Tran , Manfred Hauswirth , Danh Le Phuoc

Can Visual Question Answering (VQA) systems perform just as well when deployed in the real world? Or are they susceptible to realistic corruption effects e.g. image blur, which can be detrimental in sensitive applications, such as medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Md Farhan Ishmam , Ishmam Tashdeed , Talukder Asir Saadat , Md Hamjajul Ashmafee , Abu Raihan Mostofa Kamal , Md. Azam Hossain

Performance on the most commonly used Visual Question Answering dataset (VQA v2) is starting to approach human accuracy. However, in interacting with state-of-the-art VQA models, it is clear that the problem is far from being solved. In…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Sasha Sheng , Amanpreet Singh , Vedanuj Goswami , Jose Alberto Lopez Magana , Wojciech Galuba , Devi Parikh , Douwe Kiela

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

Aiming at answering questions based on the content of remotely sensed images, visual question answering for remote sensing data (RSVQA) has attracted much attention nowadays. However, previous works in RSVQA have focused little on the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

Large-scale language models like ChatGPT and GPT-4 have gained attention for their impressive conversational and generative capabilities. However, the creation of supervised paired question-answering data for instruction tuning presents…

Computation and Language · Computer Science 2023-05-23 Xuanyu Zhang , Qing Yang

The Visual Question Answering (VQA) system offers a user-friendly interface and enables human-computer interaction. However, VQA models commonly face the challenge of language bias, resulting from the learned superficial correlation between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu