English
Related papers

Related papers: From Easy to Hard: Learning Language-guided Curric…

200 papers

Remote Sensing Vision-Language Models (RS VLMs) have made much progress in the tasks of remote sensing (RS) image comprehension. While performing well in multi-modal reasoning and multi-turn conversations, the existing models lack…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Xu Liu , Zhouhui Lian

We study the problem of visual question answering (VQA) in images by exploiting supervised domain adaptation, where there is a large amount of labeled data in the source domain but only limited labeled data in the target domain with the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Yiming Xu , Lin Chen , Zhongwei Cheng , Lixin Duan , Jiebo Luo

Visual question answering (VQA) is a task of answering a visual question that is a pair of question and image. Some visual questions are ambiguous and some are clear, and it may be appropriate to change the ambiguity of questions from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Kento Terao , Toru Tamaki , Bisser Raytchev , Kazufumi Kaneda , Shun'ichi Satoh

Rich and dense human labeled datasets are among the main enabling factors for the recent advance on vision-language understanding. Many seemingly distant annotations (e.g., semantic segmentation and visual question answering (VQA)) are…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Chuang Gan , Yandong Li , Haoxiang Li , Chen Sun , Boqing Gong

In recent years, with the rapid advancement of transformer models, transformer-based multimodal architectures have found wide application in various downstream tasks, including but not limited to Image Captioning, Visual Question Answering…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yuduo Wang , Pedram Ghamisi

Pre-trained models with dual and cross encoders have shown remarkable success in propelling the landscape of several tasks in vision and language in Visual Question Answering (VQA). However, since they are limited by the requirements of…

Computation and Language · Computer Science 2023-01-19 Khyathi Raghavi Chandu , Alborz Geramifard

Text-based VQA aims at answering questions by reading the text present in the images. It requires a large amount of scene-text relationship understanding compared to the VQA task. Recent studies have shown that the question-answer pairs in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Visual Question answering is a challenging problem requiring a combination of concepts from Computer Vision and Natural Language Processing. Most existing approaches use a two streams strategy, computing image and question features that are…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Will Norcliffe-Brown , Efstathios Vafeias , Sarah Parisot

Learning to answer visual questions is a challenging task since the multi-modal inputs are within two feature spaces. Moreover, reasoning in visual question answering requires the model to understand both image and question, and align them…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Peixi Xiong , Yilin Shen , Hongxia Jin

Acquiring high-quality knowledge is a central focus in Knowledge-Based Visual Question Answering (KB-VQA). Recent methods use large language models (LLMs) as knowledge engines for answering. These methods generally employ image captions as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yan Zhang , Jiaqing Lin , Miao Zhang , Kui Xiao , Xiaoju Hou , Yue Zhao , Zhifei Li

With the new generation of satellite technologies, the archives of remote sensing (RS) images are growing very fast. To make the intrinsic information of each RS image easily accessible, visual question answering (VQA) has been introduced…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Tim Siebert , Kai Norman Clasen , Mahdyar Ravanbakhsh , Begüm Demir

Visual question answering (VQA) is a challenging task to provide an accurate natural language answer given an image and a natural language question about the image. It involves multi-modal learning, i.e., computer vision (CV) and natural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Luoqian Jiang , Yifan He , Jian Chen

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

Visual Question Answering (VQA) is a novel problem domain where multi-modal inputs must be processed in order to solve the task given in the form of a natural language. As the solutions inherently require to combine visual and natural…

Computer Vision and Pattern Recognition · Computer Science 2018-01-31 Mikyas T. Desta , Larry Chen , Tomasz Kornuta

Current visual question answering (VQA) tasks often require constructing multimodal datasets and fine-tuning visual language models, which demands significant time and resources. This has greatly hindered the application of VQA to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Fei Wang , Chengcheng Chen , Hongyu Chen , Yugang Chang , Weiming Zeng

Visual Question Answering (VQA) becomes one of the most active research problems in the medical imaging domain. A well-known VQA challenge is the intrinsic diversity between the image and text modalities, and in the medical VQA task, there…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yuan Zhou , Jing Mei , Yiqin Yu , Tanveer Syeda-Mahmood

Text-based Visual Question Answering~(TextVQA) aims to produce correct answers for given questions about the images with multiple scene texts. In most cases, the texts naturally attach to the surface of the objects. Therefore, spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Hao Li , Jinfa Huang , Peng Jin , Guoli Song , Qi Wu , Jie Chen

Since its inception, Visual Question Answering (VQA) is notoriously known as a task, where models are prone to exploit biases in datasets to find shortcuts instead of performing high-level reasoning. Classical methods address this by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Corentin Kervadec , Theo Jaunet , Grigory Antipov , Moez Baccouche , Romain Vuillemot , Christian Wolf

Visual Question Answering (VQA) is the task of answering a question about an image and requires processing multimodal input and reasoning to obtain the answer. Modular solutions that use declarative representations within the reasoning…

Artificial Intelligence · Computer Science 2024-10-15 Thomas Eiter , Jan Hadl , Nelson Higuera , Johannes Oetsch

Visual Question Answering (VQA) attracts much attention from both industry and academia. As a multi-modality task, it is challenging since it requires not only visual and textual understanding, but also the ability to align cross-modality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Peixi Xiong , Quanzeng You , Pei Yu , Zicheng Liu , Ying Wu