English
Related papers

Related papers: CQ-VQA: Visual Question Answering on Categorized Q…

200 papers

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

Computer Vision and Pattern Recognition · Computer Science 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Yuke Zhu , Oliver Groth , Michael Bernstein , Li Fei-Fei

Problems at the intersection of vision and language are of significant importance both as challenging research questions and for the rich set of applications they enable. However, inherent structure in our world and bias in our language…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Yash Goyal , Tejas Khot , Douglas Summers-Stay , Dhruv Batra , Devi Parikh

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in…

Medical Visual Question Answering (VQA) systems play a supporting role to understand clinic-relevant information carried by medical images. The questions to a medical image include two categories: close-end (such as Yes/No question) and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yunyi Liu , Zhanyu Wang , Dong Xu , Luping Zhou

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Christel Chappuis , Sylvain Lobry , Benjamin Kellenberger , Bertrand Le Saux , Devis Tuia

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

Artificial Intelligence · Computer Science 2016-08-30 Danna Gurari , Kristen Grauman

In recent years, multi-modal transformers have shown significant progress in Vision-Language tasks, such as Visual Question Answering (VQA), outperforming previous architectures by a considerable margin. This improvement in VQA is often…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Ankur Sikarwar , Gabriel Kreiman

We propose Encyclopedic-VQA, a large scale visual question answering (VQA) dataset featuring visual questions about detailed properties of fine-grained categories and instances. It contains 221k unique question+answer pairs each matched…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Thomas Mensink , Jasper Uijlings , Lluis Castrejon , Arushi Goel , Felipe Cadar , Howard Zhou , Fei Sha , André Araujo , Vittorio Ferrari

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Knowledge-based visual question answering (KB-VQA) demonstrates significant potential for handling knowledge-intensive tasks. However, conflicts arise between static parametric knowledge in vision language models (VLMs) and dynamically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yuyang Hong , Jiaqi Gu , Yujin Lou , Lubin Fan , Qi Yang , Ying Wang , Kun Ding , Yue Wu , Shiming Xiang , Jieping Ye

Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic…

Computation and Language · Computer Science 2024-08-23 Taehee Kim , Yeongjae Cho , Heejun Shin , Yohan Jo , Dongmyung Shin

Visual question answering (VQA) has witnessed great progress since May, 2015 as a classic problem unifying visual and textual data into a system. Many enlightening VQA works explore deep into the image and question encodings and fusing…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Yuetan Lin , Zhangyang Pang , Donghui Wang , Yueting Zhuang

The use of complex attention modules has improved the performance of the Visual Question Answering (VQA) task. This work aims to learn an improved multi-modal representation through dense interaction of visual and textual modalities. The…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Aakansha Mishra , Ashish Anand , Prithwijit Guha

Given an image and an associated textual question, the purpose of Knowledge-Based Visual Question Answering (KB-VQA) is to provide a correct answer to the question with the aid of external knowledge bases. Prior KB-VQA models are usually…

Machine Learning · Computer Science 2023-10-13 Jingru Gan , Xinzhe Han , Shuhui Wang , Qingming Huang

Visual Question Answering (VQA) is a task that requires computers to give correct answers for the input questions based on the images. This task can be solved by humans with ease but is a challenge for computers. The VLSP2022-EVJVQA shared…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Triet Minh Thai , Son T. Luu