English
Related papers

Related papers: VDocRAG: Retrieval-Augmented Generation over Visua…

200 papers

Large language models like ChatGPT are increasingly used in classrooms, but they often provide outdated or fabricated information that can mislead students. Retrieval Augmented Generation (RAG) improves reliability of LLMs by grounding…

Artificial Intelligence · Computer Science 2025-09-10 Amay Jain , Liu Cui , Si Chen

Retrieval-augmented generation (RAG) enhances large language models (LLMs) for domain-specific question-answering (QA) tasks by leveraging external knowledge sources. However, traditional RAG systems primarily focus on relevance-based…

Computation and Language · Computer Science 2025-05-26 Mohammad Reza Rezaei , Adji Bousso Dieng

Document Visual Question Answering (DocVQA) requires models to jointly understand textual semantics, spatial layout, and visual features. Current methods struggle with explicit spatial relationship modeling, inefficiency with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ahmad Mohammadshirazi , Pinaki Prasad Guha Neogi , Dheeraj Kulshrestha , Rajiv Ramnath

Proprietary corporate documents contain rich domain-specific knowledge, but their overwhelming volume and disorganized structure make it difficult even for employees to access the right information when needed. For example, in the…

Artificial Intelligence · Computer Science 2025-08-28 Nayoung Choi , Grace Byun , Andrew Chung , Ellie S. Paek , Shinsun Lee , Jinho D. Choi

Retrieval-Augmented Generation (RAG) has emerged as a promising technology for legal document consultation, yet its application in Chinese legal scenarios faces two key limitations: existing benchmarks lack specialized support for joint…

Computation and Language · Computer Science 2026-03-13 Yaocong Li , Qiang Lan , Leihan Zhang , Le Zhang

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

The volume of scientific literature is growing exponentially, leading to underutilized discoveries, duplicated efforts, and limited cross-disciplinary collaboration. Retrieval Augmented Generation (RAG) offers a way to assist scientists by…

Retrieval-Augmented Generation (RAG) enhances the accuracy of Large Language Model (LLM) responses by leveraging relevant external documents during generation. Although previous studies noted that retrieving many documents can degrade…

Computation and Language · Computer Science 2025-12-01 Shahar Levy , Nir Mazor , Lihi Shalmon , Michael Hassid , Gabriel Stanovsky

The multi-modal long-context document question-answering task aims to locate and integrate multi-modal evidences (such as texts, tables, charts, images, and layouts) distributed across multiple pages, for question understanding and answer…

Multimedia · Computer Science 2025-10-06 Ziyu Gong , Chengcheng Mai , Yihua Huang

Vision-based Retrieval-Augmented Generation (VisRAG) leverages vision-language models (VLMs) to jointly retrieve relevant visual documents and generate grounded answers based on multimodal evidence. However, existing VisRAG models degrade…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 I-Hsiang Chen , Yu-Wei Liu , Tse-Yu Wu , Yu-Chien Chiang , Jen-Chien Yang , Wei-Ting Chen

Retrieval-augmented generation (RAG) systems combine the strengths of language generation and information retrieval to power many real-world applications like chatbots. Use of RAG for understanding of videos is appealing but there are two…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Md Adnan Arefeen , Biplob Debnath , Md Yusuf Sarwar Uddin , Srimat Chakradhar

Large Vision-Language Models (LVLMs) have made remarkable strides in multimodal tasks such as visual question answering, visual grounding, and complex reasoning. However, they remain limited by static training data, susceptibility to…

Artificial Intelligence · Computer Science 2025-08-27 Chan-Wei Hu , Yueqi Wang , Shuo Xing , Chia-Ju Chen , Suofei Feng , Ryan Rossi , Zhengzhong Tu

Document images encapsulate a wealth of knowledge, while the portability of spoken queries enables broader and flexible application scenarios. Yet, no prior work has explored knowledge base question answering over visual document images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Peijin Xie , Shun Qian , Bingquan Liu , Dexin Wang , Lin Sun , Xiangzheng Zhang

Knowledge-based Visual Question Answering (KVQA) tasks require answering questions about images using extensive background knowledge. Despite significant advancements, generative models often struggle with these tasks due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yibin Yan , Weidi Xie

Retrieval-Augmented Generation (RAG) enhances language models by combining retrieval with generation. However, its current workflow remains largely text-centric, limiting its applicability in geoscience. Many geoscientific tasks are…

Emerging Technologies · Computer Science 2025-08-18 Runlong Yu , Shiyuan Luo , Rahul Ghosh , Lingyao Li , Yiqun Xie , Xiaowei Jia

Domain-specific QA systems require not just generative fluency but high factual accuracy grounded in structured expert knowledge. While recent Retrieval-Augmented Generation (RAG) frameworks improve context recall, they struggle with…

Computation and Language · Computer Science 2025-05-26 David Osei Opoku , Ming Sheng , Yong Zhang

Multimodal document question answering requires retrieving dispersed evidence from visually rich long documents and performing reliable reasoning over heterogeneous information. Existing multimodal RAG systems remain limited by two…

Information Retrieval · Computer Science 2026-03-18 Jiashu Yang , Chi Zhang , Abudukelimu Wuerkaixi , Xuxin Cheng , Cao Liu , Ke Zeng , Xu Jia , Xunliang Cai

Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Cheng Tan , Jingxuan Wei , Linzhuang Sun , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Despite initial successes and a variety of architectures, retrieval-augmented generation systems still struggle to reliably retrieve and connect the multi-step evidence required for complicated reasoning tasks. Most of the standard RAG…

Artificial Intelligence · Computer Science 2026-05-26 Jovan Pavlović , Miklós Krész , László Hajdu

In the field of Material Science, effective information retrieval systems are essential for facilitating research. Traditional Retrieval-Augmented Generation (RAG) approaches in Large Language Models (LLMs) often encounter challenges such…

Information Retrieval · Computer Science 2024-12-03 Radeen Mostafa , Mirza Nihal Baig , Mashaekh Tausif Ehsan , Jakir Hasan