English
Related papers

Related papers: Plug-and-Play VQA: Zero-shot VQA by Conjoining Lar…

200 papers

Large-scale pre-trained models (PTMs) show great zero-shot capabilities. In this paper, we study how to leverage them for zero-shot visual question answering (VQA). Our approach is motivated by a few observations. First, VQA questions often…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Rui Cao , Jing Jiang

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

Large language models (LLMs) have demonstrated excellent zero-shot generalization to new language tasks. However, effective utilization of LLMs for zero-shot visual question-answering (VQA) remains challenging, primarily due to the modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jiaxian Guo , Junnan Li , Dongxu Li , Anthony Meng Huat Tiong , Boyang Li , Dacheng Tao , Steven C. H. Hoi

Large language models (LLMs) have achieved state-of-the-art results in many natural language processing tasks. They have also demonstrated ability to adapt well to different tasks through zero-shot or few-shot settings. With the capability…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Alvin De Jun Tan , Bingquan Shen

Visual question answering (VQA) is known as an AI-complete task as it requires understanding, reasoning, and inferring about the vision and the language content. Over the past few years, numerous neural architectures have been suggested for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Övgü Özdemir , Erdem Akagündüz

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Damien Teney , Anton van den Hengel

Natural disasters usually affect vast areas and devastate infrastructures. Performing a timely and efficient response is crucial to minimize the impact on affected communities, and data-driven approaches are the best choice. Visual question…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Ehsan Karimi , Maryam Rahnemoonfar

In this paper, we explore effective prompting techniques to enhance zero- and few-shot Visual Question Answering (VQA) performance in contemporary Vision-Language Models (VLMs). Central to our investigation is the role of question templates…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Rabiul Awal , Le Zhang , Aishwarya Agrawal

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

Computation and Language · Computer Science 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

In this paper, we propose a novel language model guided captioning approach, LAMOC, for knowledge-based visual question answering (VQA). Our approach employs the generated captions by a captioning model as the context of an answer…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Yifan Du , Junyi Li , Tianyi Tang , Wayne Xin Zhao , Ji-Rong Wen

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Visual question answering (VQA) has traditionally been treated as a single-step task where each question receives the same amount of effort, unlike natural human question-answering strategies. We explore a question decomposition strategy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zaid Khan , Vijay Kumar BG , Samuel Schulter , Manmohan Chandraker , Yun Fu

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

Computation and Language · Computer Science 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Visual understanding requires interpreting both natural scenes and the textual information that appears within them, motivating tasks such as Visual Question Answering (VQA). However, current VQA benchmarks overlook scenarios with visually…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jianing An , Luyang Jiang , Jie Luo , Wenjun Wu , Lei Huang

Zero-shot visual question answering (ZS-VQA), an emerged critical research area, intends to answer visual questions without providing training samples. Existing research in ZS-VQA has proposed to leverage knowledge graphs or large language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Tao , Xiaoyang Fan , Yong Xu , Xingquan Zhu , Yufei Tang

Incorporating external knowledge to Visual Question Answering (VQA) has become a vital practical need. Existing methods mostly adopt pipeline approaches with different components for knowledge matching and extraction, feature learning,…

Artificial Intelligence · Computer Science 2021-10-19 Zhuo Chen , Jiaoyan Chen , Yuxia Geng , Jeff Z. Pan , Zonggang Yuan , Huajun Chen

Medical Visual Question Answering (VQA) is an important challenge, as it would lead to faster and more accurate diagnoses and treatment decisions. Most existing methods approach it as a multi-class classification problem, which restricts…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Tom van Sonsbeek , Mohammad Mahdi Derakhshani , Ivona Najdenkoska , Cees G. M. Snoek , Marcel Worring

A number of studies have found that today's Visual Question Answering (VQA) models are heavily driven by superficial correlations in the training data and lack sufficient image grounding. To encourage development of models geared towards…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh , Aniruddha Kembhavi

An ability to learn about new objects from a small amount of visual data and produce convincing linguistic justification about the presence/absence of certain concepts (that collectively compose the object) in novel scenarios is an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shailaja Keyur Sampat , Maitreya Patel , Yezhou Yang , Chitta Baral

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid
‹ Prev 1 2 3 10 Next ›