English
Related papers

Related papers: Fine-Tuning or Retrieval? Comparing Knowledge Inje…

200 papers

Retrieval-Augmented Generation (RAG) systems have shown promise in enhancing the performance of Large Language Models (LLMs). However, these systems face challenges in effectively integrating external knowledge with the LLM's internal…

Retrieval augmented generation (RAG) is frequently used to mitigate hallucinations and provide up-to-date knowledge for large language models (LLMs). However, given that document retrieval is an imprecise task and sometimes results in…

Computation and Language · Computer Science 2025-02-10 Kevin Wu , Eric Wu , James Zou

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in…

Information Retrieval · Computer Science 2024-11-20 Sonal Prabhune , Donald J. Berndt

Retrieval-augmented large language models (LLMs) have been remarkably competent in various NLP tasks. However, it was observed by previous works that retrieval is not always helpful, especially when the LLM is already knowledgeable on the…

Computation and Language · Computer Science 2024-12-16 Chengkai Huang , Yu Xia , Rui Wang , Kaige Xie , Tong Yu , Julian McAuley , Lina Yao

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

Computation and Language · Computer Science 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

Computation and Language · Computer Science 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Large language models (LLMs) augmented with external data have demonstrated remarkable capabilities in completing real-world tasks. Techniques for integrating external data into LLMs, such as Retrieval-Augmented Generation (RAG) and…

Computation and Language · Computer Science 2024-09-24 Siyun Zhao , Yuqing Yang , Zilong Wang , Zhiyuan He , Luna K. Qiu , Lili Qiu

In this study, we explore the fine-tuning of Large Language Models (LLMs) to better support policymakers in their crucial work of understanding, analyzing, and crafting legal regulations. To equip the model with a deep understanding of…

Computation and Language · Computer Science 2025-11-06 One Octadion , Bondan Sapta Prakoso , Nanang Yudi Setiawan , Novanto Yudistira

There are two common ways in which developers are incorporating proprietary and domain-specific data when building applications of Large Language Models (LLMs): Retrieval-Augmented Generation (RAG) and Fine-Tuning. RAG augments the prompt…

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

Information Retrieval · Computer Science 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

Computation and Language · Computer Science 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu

Retrieval Augmented Generation (RAG) represents a significant advancement in artificial intelligence combining a retrieval phase with a generative phase, with the latter typically being powered by large language models (LLMs). The current…

Computation and Language · Computer Science 2024-06-24 Florin Cuconasu , Giovanni Trappolini , Nicola Tonellotto , Fabrizio Silvestri

Retrieval-augmented generation (RAG) generally enhances large language models' (LLMs) ability to solve knowledge-intensive tasks. But RAG may also lead to performance degradation due to imperfect retrieval and the model's limited ability to…

Computation and Language · Computer Science 2025-05-29 Shuyang Cao , Karthik Radhakrishnan , David Rosenberg , Steven Lu , Pengxiang Cheng , Lu Wang , Shiyue Zhang

Retrieval-augmented generation (RAG) has shown impressive capability in providing reliable answer predictions and addressing hallucination problems. A typical RAG implementation uses powerful retrieval models to extract external information…

Information Retrieval · Computer Science 2024-11-19 Ziwei Liu , Liang Zhang , Qian Li , Jianghua Wu , Guangxu Zhu

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

Information Retrieval · Computer Science 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

Computation and Language · Computer Science 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac