English
Related papers

Related papers: Knowledge-Routed Visual Question Reasoning: Challe…

200 papers

Visual question answering (VQA) has been gaining a lot of traction in the machine learning community in the recent years due to the challenges posed in understanding information coming from multiple modalities (i.e., images, language). In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Muralikrishnna G. Sethuraman , Ali Payani , Faramarz Fekri , J. Clayton Kerce

In recent years, visual question answering (VQA) has attracted attention from the research community because of its highly potential applications (such as virtual assistance on intelligent cars, assistant devices for blind people, or…

Computation and Language · Computer Science 2023-10-03 Nghia Hieu Nguyen , Duong T. D. Vo , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Visual Question Answering (VQA) is a challenging task that requires the joint understanding of natural language and visual content. While early research primarily focused on recognizing objects and scene context, it often overlooked scene…

In this work, we propose a deep neural architecture that uses an attention mechanism which utilizes region based image features, the natural language question asked, and semantic knowledge extracted from the regions of an image to produce…

Computation and Language · Computer Science 2021-04-06 Tasmia Tasrin , Md Sultan Al Nahian , Brent Harrison

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

We present an empirical study of active learning for Visual Question Answering, where a deep VQA model selects informative question-image pairs from a pool and queries an oracle for answers to maximally improve its performance under a…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Xiao Lin , Devi Parikh

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Visual Question Answering (VQA) requires reasoning across visual and textual modalities, yet Large Vision-Language Models (LVLMs) often lack integrated commonsense knowledge, limiting their robustness in real-world scenarios. To address…

Computation and Language · Computer Science 2025-06-12 Shuo Yang , Siwen Luo , Soyeon Caren Han , Eduard Hovy

We propose Encyclopedic-VQA, a large scale visual question answering (VQA) dataset featuring visual questions about detailed properties of fine-grained categories and instances. It contains 221k unique question+answer pairs each matched…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Thomas Mensink , Jasper Uijlings , Lluis Castrejon , Arushi Goel , Felipe Cadar , Howard Zhou , Fei Sha , André Araujo , Vittorio Ferrari

With the rapid development of remote sensing image archives, asking questions about images has become an effective way of gathering specific information or performing semantic image retrieval. However, current automatically generated…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Siran Li , Li Mi , Javiera Castillo-Navarro , Devis Tuia

Visual question answering is a task of predicting the answer to a question about an image. Given that different people can provide different answers to a visual question, we aim to better understand why with answer groundings. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Chongyan Chen , Samreen Anjum , Danna Gurari

Question answering is an important task for autonomous agents and virtual assistants alike and was shown to support the disabled in efficiently navigating an overwhelming environment. Many existing methods focus on observation-based…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Medhini Narasimhan , Alexander G. Schwing

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visual impairments learn…

Computation and Language · Computer Science 2022-10-28 Yang Trista Cao , Kyle Seelman , Kyungjun Lee , Hal Daumé

Current visual question answering datasets do not consider the rich semantic information conveyed by text within an image. In this work, we present a new dataset, ST-VQA, that aims to highlight the importance of exploiting high-level…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Ali Furkan Biten , Ruben Tito , Andres Mafla , Lluis Gomez , Marçal Rusiñol , Ernest Valveny , C. V. Jawahar , Dimosthenis Karatzas

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

Knowledge-based Visual Question Answering (KVQA) tasks require answering questions about images using extensive background knowledge. Despite significant advancements, generative models often struggle with these tasks due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yibin Yan , Weidi Xie

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

In order to answer semantically-complicated questions about an image, a Visual Question Answering (VQA) model needs to fully understand the visual scene in the image, especially the interactive dynamics between different objects. We propose…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Linjie Li , Zhe Gan , Yu Cheng , Jingjing Liu

Visual question answering (VQA) task not only bridges the gap between images and language, but also requires that specific contents within the image are understood as indicated by linguistic context of the question, in order to generate the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Kuniaki Saito , Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada
‹ Prev 1 8 9 10 Next ›