中文
相关论文

相关论文: Bridging the Preference Gap between Retrievers and…

200 篇论文

Large language models (LLMs) have demonstrated remarkable in-context reasoning capabilities across a wide range of tasks, particularly with unstructured inputs such as language or images. However, LLMs struggle to handle structured data,…

机器学习 · 计算机科学 2025-02-20 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Liang Chen , Zibin Zheng

Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable…

计算与语言 · 计算机科学 2024-10-08 Shi-Qi Yan , Jia-Chen Gu , Yun Zhu , Zhen-Hua Ling

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical…

信息检索 · 计算机科学 2025-09-10 Haoxiang Jin , Ronghan Li , Zixiang Lu , Qiguang Miao

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

计算与语言 · 计算机科学 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

信息检索 · 计算机科学 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

计算与语言 · 计算机科学 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

信息检索 · 计算机科学 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

Retrieval Augmented Generation (RAG) has emerged as a crucial technique for enhancing the accuracy of Large Language Models (LLMs) by incorporating external information. With the advent of LLMs that support increasingly longer context…

机器学习 · 计算机科学 2024-11-07 Quinn Leng , Jacob Portes , Sam Havens , Matei Zaharia , Michael Carbin

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

计算与语言 · 计算机科学 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

As an important paradigm for enhancing the generation quality of Large Language Models (LLMs), retrieval-augmented generation (RAG) faces the two challenges regarding retrieval accuracy and computational efficiency. This paper presents a…

信息检索 · 计算机科学 2026-05-29 Zihang Li , Wenjun Liu , Yikun Zong , Jiawen Tao , Siying Dai , Songcheng Ren , Zirui Liu , Yuhang Wang , Yanbing Jiang , Tong Yang

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

计算与语言 · 计算机科学 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

Multilingual Retrieval-Augmented Generation (mRAG) systems enhance language models by integrating external multilingual information to produce context-aware responses. However, mRAG systems struggle with retrieving relevant information due…

计算与语言 · 计算机科学 2025-06-03 Jeonghyun Park , Hwanhee Lee

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to enhance large language models (LLMs) by integrating external knowledge retrieval with generative capabilities. While significant advancements have been…

人机交互 · 计算机科学 2025-08-11 Sizhe Cheng , Jiaping Li , Huanchen Wang , Yuxin Ma

Retrieval-augmented generation (RAG) improves language model (LM) performance by providing relevant context at test time for knowledge-intensive situations. However, the relationship between parametric knowledge acquired during pretraining…

计算与语言 · 计算机科学 2026-04-02 Karan Singh , Michael Yu , Varun Gangal , Zhuofu Tao , Sachin Kumar , Emmy Liu , Steven Y. Feng

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

计算与语言 · 计算机科学 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Large language models (LLMs) augmented with external data have demonstrated remarkable capabilities in completing real-world tasks. Techniques for integrating external data into LLMs, such as Retrieval-Augmented Generation (RAG) and…

计算与语言 · 计算机科学 2024-09-24 Siyun Zhao , Yuqing Yang , Zilong Wang , Zhiyuan He , Luna K. Qiu , Lili Qiu

This paper presents an experience report on the development of Retrieval Augmented Generation (RAG) systems using PDF documents as the primary data source. The RAG architecture combines generative capabilities of Large Language Models…

软件工程 · 计算机科学 2024-10-22 Ayman Asad Khan , Md Toufique Hasan , Kai Kristian Kemell , Jussi Rasku , Pekka Abrahamsson

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

信息检索 · 计算机科学 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac