English
Related papers

Related papers: GC-KBVQA: A New Four-Stage Framework for Enhancing…

200 papers

Visual understanding requires interpreting both natural scenes and the textual information that appears within them, motivating tasks such as Visual Question Answering (VQA). However, current VQA benchmarks overlook scenarios with visually…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jianing An , Luyang Jiang , Jie Luo , Wenjun Wu , Lei Huang

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Knowledge Base Question Answering (KBQA) aims to answer natural language questions with factual information such as entities and relations in KBs. However, traditional Pre-trained Language Models (PLMs) are directly pre-trained on…

Computation and Language · Computer Science 2023-08-29 Guanting Dong , Rumei Li , Sirui Wang , Yupeng Zhang , Yunsen Xian , Weiran Xu

Knowledge-based visual question answering (VQA) requires answering questions with external knowledge in addition to the content of images. One dataset that is mostly used in evaluating knowledge-based VQA is OK-VQA, but it lacks a gold…

Computation and Language · Computer Science 2021-09-10 Man Luo , Yankai Zeng , Pratyay Banerjee , Chitta Baral

Text-rich VQA, namely Visual Question Answering based on text recognition in the images, is a cross-modal task that requires both image comprehension and text recognition. In this work, we focus on investigating the advantages and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xuejing Liu , Wei Tang , Xinzhe Ni , Jinghui Lu , Rui Zhao , Zechao Li , Fei Tan

Recent advancements in Large Video Language Models (LVLMs) have highlighted their potential for multi-modal understanding, yet evaluating their factual grounding in videos remains a critical unsolved challenge. To address this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Meng Cao , Pengfei Hu , Yingyao Wang , Jihao Gu , Haoran Tang , Haoze Zhao , Chen Wang , Jiahua Dong , Wangbo Yu , Ge Zhang , Jun Song , Xiang Li , Bo Zheng , Ian Reid , Xiaodan Liang

Video Question Answering (VideoQA) is the task of answering questions about a video. At its core is understanding the alignments between visual scenes in video and linguistic semantics in question to yield the answer. In leading VideoQA…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yicong Li , Xiang Wang , Junbin Xiao , Wei Ji , Tat-Seng Chua

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

We propose a novel VQA dataset, BloomVQA, to facilitate comprehensive evaluation of large vision-language models on comprehension tasks. Unlike current benchmarks that often focus on fact-based memorization and simple reasoning tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Yunye Gong , Robik Shrestha , Jared Claypoole , Michael Cogswell , Arijit Ray , Christopher Kanan , Ajay Divakaran

The current research direction in generative models, such as the recently developed GPT4, aims to find relevant knowledge information for multimodal and multilingual inputs to provide answers. Under these research circumstances, the demand…

Computation and Language · Computer Science 2024-08-01 Minjun Kim , Seungwoo Song , Youhan Lee , Haneol Jang , Kyungtae Lim

Multimodal large language models (MLLMs) have demonstrated great performance on visual question answering (VQA). When it comes to knowledge-based Visual Question Answering (KB-VQA), MLLMs may lack the specialized domain knowledge needed to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Weixi Weng , Jieming Zhu , Xiaojun Meng , Hao Zhang , Rui Zhang , Chun Yuan

This paper revisits visual representation in knowledge-based visual question answering (VQA) and demonstrates that using regional information in a better way can significantly improve the performance. While visual representation is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yuanze Lin , Yujia Xie , Dongdong Chen , Yichong Xu , Chenguang Zhu , Lu Yuan

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

Computation and Language · Computer Science 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Visual quality assessment (VQA) is increasingly shifting from scalar score prediction toward interpretable quality understanding -- a paradigm that demands \textit{fine-grained spatiotemporal perception} and \textit{auxiliary contextual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Kaiwei Zhang , Jun Jia , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

Methods for teaching machines to answer visual questions have made significant progress in recent years, but current methods still lack important human capabilities, including integrating new visual classes and concepts in a modular manner,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Ben-Zion Vatashsky , Shimon Ullman

Graph Visual Question Answering (GVQA) for autonomous driving organizes reasoning into ordered stages, namely Perception, Prediction, and Planning, where planning decisions should remain consistent with the model's own perception. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Gautam Kumar Jain , Carsten Markgraf , Julian Stähler

Large language models (LLMs) based on generative pre-trained Transformer have achieved remarkable performance on knowledge graph question-answering (KGQA) tasks. However, LLMs often produce ungrounded subgraph planning or reasoning results…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Kehai Chen , Xuefeng Bai , Muyun Yang , Tiejun Zhao , Min Zhang

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat

Transformer-based architectures have recently demonstrated remarkable performance in the Visual Question Answering (VQA) task. However, such models are likely to disregard crucial visual cues and often rely on multimodal shortcuts and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Maria Parelli , Dimitrios Mallis , Markos Diomataris , Vassilis Pitsikalis

Aligning the recent large language models (LLMs) with computer vision models leads to large vision-language models (LVLMs), which have paved the way for zero-shot image reasoning tasks. However, LVLMs are usually trained on short high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Kaiwen Yang , Tao Shen , Xinmei Tian , Xiubo Geng , Chongyang Tao , Dacheng Tao , Tianyi Zhou