English
Related papers

Related papers: R-VQA: Learning Visual Relation Facts with Semanti…

200 papers

Visual Question Answering (VQA) is a challenging task of natural language processing (NLP) and computer vision (CV), attracting significant attention from researchers. English is a resource-rich language that has witnessed various…

Computation and Language · Computer Science 2024-04-18 Ngan Luu-Thuy Nguyen , Nghia Hieu Nguyen , Duong T. D Vo , Khanh Quoc Tran , Kiet Van Nguyen

The widely used Fact-based Visual Question Answering (FVQA) dataset contains visually-grounded questions that require information retrieval using common sense knowledge graphs to answer. It has been observed that the original dataset is…

Computation and Language · Computer Science 2023-03-21 Weizhe Lin , Zhilin Wang , Bill Byrne

Visual question answering (VQA) in medical imaging aims to support clinical diagnosis by automatically interpreting complex imaging data in response to natural language queries. Existing studies typically rely on distinct visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yuanhe Tian , Chen Su , Junwen Duan , Yan Song

Visual question answering (VQA) requires systems to perform concept-level reasoning by unifying unstructured (e.g., the context in question and answer; "QA context") and structured (e.g., knowledge graph for the QA context and scene;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Yanan Wang , Michihiro Yasunaga , Hongyu Ren , Shinya Wada , Jure Leskovec

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

This paper introduces the task of visual question answering for remote sensing data (RSVQA). Remote sensing images contain a wealth of information which can be useful for a wide range of tasks including land cover classification, object…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Sylvain Lobry , Diego Marcos , Jesse Murray , Devis Tuia

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

Computation and Language · Computer Science 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

In this paper, we establish a benchmark for table visual question answering, referred to as the TableVQA-Bench, derived from pre-existing table question-answering (QA) and table structure recognition datasets. It is important to note that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yoonsik Kim , Moonbin Yim , Ka Yeon Song

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Damien Teney , Anton van den Hengel

Attention models are widely used in Vision-language (V-L) tasks to perform the visual-textual correlation. Humans perform such a correlation with a strong linguistic understanding of the visual world. However, even the best performing…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Gouthaman KV , Athira Nambiar , Kancheti Sai Srinivas , Anurag Mittal

In recent years, visual question answering (VQA) has attracted attention from the research community because of its highly potential applications (such as virtual assistance on intelligent cars, assistant devices for blind people, or…

Computation and Language · Computer Science 2023-10-03 Nghia Hieu Nguyen , Duong T. D. Vo , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

Computation and Language · Computer Science 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

Visual Question Answering (VQA) is of tremendous interest to the research community with important applications such as aiding visually impaired users and image-based search. In this work, we explore the use of scene graphs for solving the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Vinay Damodaran , Sharanya Chakravarthy , Akshay Kumar , Anjana Umapathy , Teruko Mitamura , Yuta Nakashima , Noa Garcia , Chenhui Chu

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Aditya Kane , V Manushree , Sahil Khose

Questions that require counting a variety of objects in images remain a major challenge in visual question answering (VQA). The most common approaches to VQA involve either classifying answers based on fixed length representations of both…

Artificial Intelligence · Computer Science 2018-03-05 Alexander Trott , Caiming Xiong , Richard Socher

This paper proposes CQ-VQA, a novel 2-level hierarchical but end-to-end model to solve the task of visual question answering (VQA). The first level of CQ-VQA, referred to as question categorizer (QC), classifies questions to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Aakansha Mishra , Ashish Anand , Prithwijit Guha

An ability to learn about new objects from a small amount of visual data and produce convincing linguistic justification about the presence/absence of certain concepts (that collectively compose the object) in novel scenarios is an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shailaja Keyur Sampat , Maitreya Patel , Yezhou Yang , Chitta Baral