English
Related papers

Related papers: Multimodal Adaptive Retrieval Augmented Generation…

200 papers

Multimodal Retrieval-Augmented Generation (MMRAG) has been introduced to enhance Multimodal Large Language Models by incorporating externally retrieved multimodal knowledge, but it introduces two challenges: Parametric-Retrieved Knowledge…

Computation and Language · Computer Science 2025-06-06 Yang Tian , Fan Liu , Jingyuan Zhang , Victoria W. , Yupeng Hu , Liqiang Nie

Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Cheng Tan , Jingxuan Wei , Linzhuang Sun , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

Computation and Language · Computer Science 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen

Retrieval-augmented generation (RAG) techniques have emerged as a promising solution to enhance the reliability of large language models (LLMs) by addressing issues like hallucinations, outdated knowledge, and domain adaptation. In…

Computation and Language · Computer Science 2025-01-28 Weihang Su , Yichen Tang , Qingyao Ai , Junxi Yan , Changyue Wang , Hongning Wang , Ziyi Ye , Yujia Zhou , Yiqun Liu

Retrieval-Augmented Generation (RAG) is a powerful strategy for improving the factual accuracy of models by retrieving external knowledge relevant to queries and incorporating it into the generation process. However, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Soyeong Jeong , Kangsan Kim , Jinheon Baek , Sung Ju Hwang

Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current methods mainly employ separate retrieval and generation modules to acquire external knowledge and generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xinwei Long , Zhiyuan Ma , Ermo Hua , Kaiyan Zhang , Biqing Qi , Bowen Zhou

The evolution of digital manufacturing requires intelligent Question Answering (QA) systems that can seamlessly integrate and analyze complex multi-modal data, such as text, images, formulas, and tables. Conventional Retrieval Augmented…

Computational Engineering, Finance, and Science · Computer Science 2026-01-27 Yunqing Li , Zihan Dong , Farhad Ameri , Jianbang Zhang

Retrieval-Augmented Generation (RAG) was introduced to enhance the capabilities of Large Language Models (LLMs) beyond their encoded prior knowledge. This is achieved by providing LLMs with an external source of knowledge, which helps…

Computation and Language · Computer Science 2026-03-11 Hazem Amamou , Stéphane Gagnon , Alan Davoust , Anderson R. Avila

Retrieval-augmented Generation (RAG) is a prevalent approach for domain-specific LLMs, yet it is often plagued by "Retrieval Hallucinations"--a phenomenon where fine-tuned models fail to recognize and act upon poor-quality retrieved…

Artificial Intelligence · Computer Science 2026-01-21 Letian Zhang , Guanghao Meng , Xudong Ren , Yiming Wang , Shu-Tao Xia

Retrieval-Augmented Generation (RAG) improves large language models by retrieving external knowledge, often truncated into smaller chunks due to the input context window, which leads to information loss, resulting in response hallucinations…

Computation and Language · Computer Science 2025-11-18 Jie Zhang , Bo Tang , Wanzi Shao , Wenqiang Wei , Jihao Zhao , Jianqing Zhu , Zhiyu li , Wen Xi , Zehao Lin , Feiyu Xiong , Yanchao Tan

Retrieval-augmented generation (RAG) is widely utilized to incorporate external knowledge into large language models, thereby enhancing factuality and reducing hallucinations in question-answering (QA) tasks. A standard RAG pipeline…

Computation and Language · Computer Science 2025-10-08 Yiqun Chen , Lingyong Yan , Weiwei Sun , Xinyu Ma , Yi Zhang , Shuaiqiang Wang , Dawei Yin , Yiming Yang , Jiaxin Mao

Retrieval-Augmented Generation (RAG) enhances language models by retrieving and incorporating relevant external knowledge. However, traditional retrieve-and-generate processes may not be optimized for real-world scenarios, where queries…

Computation and Language · Computer Science 2025-02-28 Ingeol Baek , Hwan Chang , Byeongjeong Kim , Jimin Lee , Hwanhee Lee

With the rapid advancement of Multi-modal Large Language Models (MLLMs), their capability in understanding both images and text has greatly improved. However, their potential for leveraging multi-modal contextual information in…

Artificial Intelligence · Computer Science 2025-08-08 Zhenghao Liu , Xingsheng Zhu , Tianshuo Zhou , Xinyi Zhang , Xiaoyuan Yi , Yukun Yan , Ge Yu , Maosong Sun

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…

Adaptive retrieval-augmented generation (ARAG) aims to dynamically determine the necessity of retrieval for queries instead of retrieving indiscriminately to enhance the efficiency and relevance of the sourced information. However, previous…

Computation and Language · Computer Science 2024-06-06 Zihan Zhang , Meng Fang , Ling Chen

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Vision-language models (VLMs) have achieved strong performance in visual question answering (VQA), yet they remain constrained by static training data. Retrieval-Augmented Generation (RAG) mitigates this limitation by enabling access to…

Computation and Language · Computer Science 2026-03-24 David Anugraha , Patrick Amadeus Irawan , Anshul Singh , En-Shiun Annie Lee , Genta Indra Winata

Retrieval-augmented generation (RAG) has proven to be effective in mitigating hallucinations in large language models, yet its effectiveness remains limited in complex, multi-step reasoning scenarios. Recent efforts have incorporated…

Computation and Language · Computer Science 2025-12-29 Wenda Wei , Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Lixin Su , Shuaiqiang Wang , Dawei Yin , Maarten de Rijke , Xueqi Cheng