English
Related papers

Related papers: A Survey on RAG Meeting LLMs: Towards Retrieval-Au…

200 papers

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Recently, Retrieval-Augmented Generation (RAG) has achieved remarkable success in addressing the challenges of Large Language Models (LLMs) without necessitating retraining. By referencing an external knowledge base, RAG refines LLM…

Artificial Intelligence · Computer Science 2024-09-11 Boci Peng , Yun Zhu , Yongchao Liu , Xiaohe Bo , Haizhou Shi , Chuntao Hong , Yan Zhang , Siliang Tang

Retrieval-Augmented Generation (RAG) is a promising approach for mitigating the hallucination of large language models (LLMs). However, existing research lacks rigorous evaluation of the impact of retrieval-augmented generation on different…

Computation and Language · Computer Science 2023-12-21 Jiawei Chen , Hongyu Lin , Xianpei Han , Le Sun

Large language models (LLMs) have emerged as powerful tools for knowledge-intensive tasks across domains. In materials science, to find novel materials for various energy efficient devices for various real-world applications, requires…

Materials Science · Physics 2025-08-12 Agada Joseph Oche , Arpan Biswas

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

Computation and Language · Computer Science 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Large Language Models (LLMs) are smart but forgetful. Recent studies, (e.g., (Bubeck et al., 2023)) on modern LLMs have shown that they are capable of performing amazing tasks typically necessitating human-level intelligence. However,…

Computation and Language · Computer Science 2023-11-08 Eric Melz

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly…

Computation and Language · Computer Science 2024-06-18 Shuting Wang , Jiongnan Liu , Shiren Song , Jiehan Cheng , Yuqi Fu , Peidong Guo , Kun Fang , Yutao Zhu , Zhicheng Dou

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

In real-world applications with Large Language Models (LLMs), external retrieval mechanisms - such as Search-Augmented Generation (SAG), tool utilization, and Retrieval-Augmented Generation (RAG) - are often employed to enhance the quality…

Computation and Language · Computer Science 2025-02-25 Tzu-Lin Kuo , Feng-Ting Liao , Mu-Wei Hsieh , Fu-Chieh Chang , Po-Chun Hsu , Da-Shan Shiu

Advancements in model algorithms, the growth of foundational models, and access to high-quality datasets have propelled the evolution of Artificial Intelligence Generated Content (AIGC). Despite its notable successes, AIGC still faces…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Penghao Zhao , Hailin Zhang , Qinhan Yu , Zhengren Wang , Yunteng Geng , Fangcheng Fu , Ling Yang , Wentao Zhang , Jie Jiang , Bin Cui

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Retrieval-Augmented Generation (RAG) systems have shown promise in enhancing the performance of Large Language Models (LLMs). However, these systems face challenges in effectively integrating external knowledge with the LLM's internal…

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

Computation and Language · Computer Science 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Retrieval-augmented generation (RAG) has emerged as a pivotal technique in artificial intelligence (AI), particularly in enhancing the capabilities of large language models (LLMs) by enabling access to external, reliable, and up-to-date…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xu Zheng , Ziqiao Weng , Yuanhuiyi Lyu , Lutao Jiang , Haiwei Xue , Bin Ren , Danda Paudel , Nicu Sebe , Luc Van Gool , Xuming Hu

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

Information Retrieval · Computer Science 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

Retrieval Augmented Generation (RAG) represents a significant advancement in artificial intelligence combining a retrieval phase with a generative phase, with the latter typically being powered by large language models (LLMs). The current…

Computation and Language · Computer Science 2024-06-24 Florin Cuconasu , Giovanni Trappolini , Nicola Tonellotto , Fabrizio Silvestri

Retrieval-augmented generation (RAG) techniques have emerged as a promising solution to enhance the reliability of large language models (LLMs) by addressing issues like hallucinations, outdated knowledge, and domain adaptation. In…

Computation and Language · Computer Science 2025-01-28 Weihang Su , Yichen Tang , Qingyao Ai , Junxi Yan , Changyue Wang , Hongning Wang , Ziyi Ye , Yujia Zhou , Yiqun Liu

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

Information Retrieval · Computer Science 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang