English
Related papers

Related papers: Efficient Multimodal Planning Agent for Visual Que…

200 papers

Document Visual Question Answering (DocVQA) remains challenging for existing Vision-Language Models (VLMs), especially under complex reasoning and multi-step workflows. Current approaches struggle to decompose intricate questions into…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Aymen Lassoued , Mohamed Ali Souibgui , Yousri Kessentini

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria

Document Visual Question Answering (DocVQA) faces dual challenges in processing lengthy multimodal documents (text, images, tables) and performing cross-modal reasoning. Current document retrieval-augmented generation (DocRAG) methods…

Information Retrieval · Computer Science 2025-11-10 Kuicai Dong , Yujing Chang , Shijie Huang , Yasheng Wang , Ruiming Tang , Yong Liu

Retrieval-augmented generation (RAG) is an effective technique that enables large language models (LLMs) to utilize external knowledge sources for generation. However, current RAG systems are solely based on text, rendering it impossible to…

Information Retrieval · Computer Science 2025-03-04 Shi Yu , Chaoyue Tang , Bokai Xu , Junbo Cui , Junhao Ran , Yukun Yan , Zhenghao Liu , Shuo Wang , Xu Han , Zhiyuan Liu , Maosong Sun

Vision-Language Models (VLMs) excel at visual reasoning but still struggle with integrating external knowledge. Retrieval-Augmented Generation (RAG) is a promising solution, but current methods remain inefficient and often fail to maintain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Gen Li , Peiyu Liu

This study explores innovative methods for improving Visual Question Answering (VQA) using Generative Adversarial Networks (GANs), autoencoders, and attention mechanisms. Leveraging a balanced VQA dataset, we investigate three distinct…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Panfeng Li , Qikai Yang , Xieming Geng , Wenjing Zhou , Zhicheng Ding , Yi Nian

We present MA-RAG, a Multi-Agent framework for Retrieval-Augmented Generation (RAG) that addresses the inherent ambiguities and reasoning challenges in complex information-seeking tasks. Unlike conventional RAG methods that rely on…

Computation and Language · Computer Science 2025-10-14 Thang Nguyen , Peter Chin , Yu-Wing Tai

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

The evolution of digital manufacturing requires intelligent Question Answering (QA) systems that can seamlessly integrate and analyze complex multi-modal data, such as text, images, formulas, and tables. Conventional Retrieval Augmented…

Computational Engineering, Finance, and Science · Computer Science 2026-01-27 Yunqing Li , Zihan Dong , Farhad Ameri , Jianbang Zhang

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Multi-modal Retrieval-Augmented Generation (RAG) has emerged as a highly effective paradigm for Knowledge-Based Visual Question Answering (KB-VQA). Despite recent advancements, prevailing methods still primarily depend on images as the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yingjian Zhu , Xinming Wang , Kun Ding , Ying Wang , Bin Fan , Shiming Xiang

Understanding information from a collection of multiple documents, particularly those with visually rich elements, is important for document-grounded question answering. This paper introduces VisDoMBench, the first comprehensive benchmark…

Computation and Language · Computer Science 2025-02-12 Manan Suri , Puneet Mathur , Franck Dernoncourt , Kanika Goswami , Ryan A. Rossi , Dinesh Manocha

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid

Video question answering (VideoQA) is a challenging task that requires integrating spatial, temporal, and semantic information to capture the complex dynamics of video sequences. Although recent advances have introduced various approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zhongyu Yang , Zuhao Yang , Shuo Zhan , Tan Yue , Wei Pang , Yingfang Yuan

Retrieval-Augmented Generation (RAG) has been introduced to mitigate hallucinations in Multimodal Large Language Models (MLLMs) by incorporating external knowledge into the generation process, and it has become a widely adopted approach for…

Artificial Intelligence · Computer Science 2026-03-17 Zhuohang Jiang , Pangjing Wu , Xu Yuan , Wenqi Fan , Qing Li

Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal structures. While retrieval-augmented generation (RAG) has shown strong performance in…

Information Retrieval · Computer Science 2026-04-21 Hui Wu , Haoquan Zhai , Yuchen Li , Hengyi Cai , Peirong Zhang , Yidan Zhang , Lei Wang , Chunle Wang , Yingyan Hou , Shuaiqiang Wang , Dawei Yin

Although Vision Language Models (VLMs) have shown strong generalization in medical imaging, pathology presents unique challenges due to ultra-high resolution, complex tissue structures, and nuanced clinical semantics. These factors make…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Jingru Guo , Hengzhe Zhang , Penghao Zhang , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu