中文
相关论文

相关论文: Bridging External and Parametric Knowledge: Mitiga…

200 篇论文

Retrieval-Augmented Generation (RAG) models frequently encounter hallucination phenomena when integrating external information with internal parametric knowledge. Empirical studies demonstrate that the disequilibrium between external…

计算与语言 · 计算机科学 2025-05-13 Lei Wang

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Retrieval-Augmented Generation (RAG) has significantly improved the performance of large language models (LLMs) on knowledge-intensive tasks in recent years. However, since retrieval systems may return irrelevant content, incorporating such…

计算与语言 · 计算机科学 2025-09-26 Tomoaki Isoda

The Retrieval-augmented generation (RAG) system based on Large language model (LLM) has made significant progress. It can effectively reduce factuality hallucinations, but faithfulness hallucinations still exist. Previous methods for…

计算与语言 · 计算机科学 2026-01-07 Jianpeng Hu , Yanzeng Li , Jialun Zhong , Wenfa Qi , Lei Zou

Recent advances in large language models (LLMs) have led to impressive progress in natural language generation, yet their tendency to produce hallucinated or unsubstantiated content remains a critical concern. To improve factual…

计算与语言 · 计算机科学 2025-05-20 Xukai Liu , Ye Liu , Shiwen Wu , Yanghai Zhang , Yihao Yuan , Kai Zhang , Qi Liu

Retrieval-Augmented Generation (RAG) was introduced to enhance the capabilities of Large Language Models (LLMs) beyond their encoded prior knowledge. This is achieved by providing LLMs with an external source of knowledge, which helps…

计算与语言 · 计算机科学 2026-03-11 Hazem Amamou , Stéphane Gagnon , Alan Davoust , Anderson R. Avila

Retrieval-augmented generation (RAG) incorporates external knowledge into large language models (LLMs), improving their adaptability to downstream tasks and enabling information updates. Surprisingly, recent empirical evidence demonstrates…

计算与语言 · 计算机科学 2026-01-08 Yang Sun , Zhiyong Xie , Lixin Zou , Dan Luo , Min Tang , Xiangyu Zhao , Yunwei Zhao , Xixun Lin , Yanxiong Lu , Chenliang Li

Retrieval-Augmented Generation (RAG) mitigates hallucination in Large Language Models (LLMs) by incorporating external data, with Knowledge Graphs (KGs) offering crucial information for question answering. Traditional Knowledge Graph…

计算与语言 · 计算机科学 2025-09-08 Yushi Sun , Kai Sun , Yifan Ethan Xu , Xiao Yang , Xin Luna Dong , Nan Tang , Lei Chen

Retrieval-Augmented Generation (RAG) aims to mitigate hallucinations in large language models (LLMs) by grounding responses in retrieved documents. Yet, RAG-based LLMs still hallucinate even when provided with correct and sufficient…

计算与语言 · 计算机科学 2026-02-04 Samuel Yeh , Sharon Li , Tanwi Mallick

Large language models (LLMs) have achieved strong empirical performance in various fields, benefiting from their huge amount of parameters that store knowledge. However, LLMs still suffer from several key issues, such as hallucination…

计算与语言 · 计算机科学 2026-05-20 Shangyu Wu , Ying Xiong , Yufei Cui , Haolun Wu , Can Chen , Ye Yuan , Lianming Huang , Xue Liu , Tei-Wei Kuo , Nan Guan , Chun Jason Xue

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

计算与语言 · 计算机科学 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Retrieval-augmented generation (RAG) is a widely used framework for reducing hallucinations in large language models (LLMs) on domain-specific tasks by retrieving relevant documents from a database to support accurate responses. However,…

密码学与安全 · 计算机科学 2026-02-17 Tingting Tang , James Flemings , Yongqin Wang , Murali Annavaram

Large Language Models (LLMs) have shown promising performance on diverse medical benchmarks, highlighting their potential in supporting real-world clinical tasks. Retrieval-Augmented Generation (RAG) has emerged as a key approach for…

计算与语言 · 计算机科学 2025-09-30 Kaishuai Xu , Wenjun Hou , Yi Cheng , Wenjie Li

Sequential Recommendation System~(SRS) has become pivotal in modern society, which predicts subsequent actions based on the user's historical behavior. However, traditional collaborative filtering-based sequential recommendation models…

信息检索 · 计算机科学 2025-11-26 Tianjie Dai , Xu Chen , Yunmeng Shu , Jinsong Lan , Xiaoyong Zhu , Jiangchao Yao , Bo Zheng

Retrieval-augmented generation (RAG) appears as a promising method to alleviate the "hallucination" problem in large language models (LLMs), since it can incorporate external traceable resources for response generation. The essence of RAG…

计算与语言 · 计算机科学 2024-10-16 Haosheng Qian , Yixing Fan , Ruqing Zhang , Jiafeng Guo

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet exhibit critical limitations in knowledge-intensive tasks, often generating hallucinations when faced with questions requiring…

计算与语言 · 计算机科学 2026-01-08 Yilin Xiao , Chuang Zhou , Yujing Zhang , Qinggang Zhang , Su Dong , Shengyuan Chen , Chang Yang , Xiao Huang

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Retrieval-augmented generation (RAG) is a common strategy to reduce hallucinations in Large Language Models (LLMs). While reinforcement learning (RL) can enable LLMs to act as search agents by activating retrieval capabilities, existing…

计算与语言 · 计算机科学 2025-05-13 Ziyang Huang , Xiaowei Yuan , Yiming Ju , Jun Zhao , Kang Liu

Retrieval-Augmented Generation (RAG) has become a widely adopted approach to enhance Large Language Models (LLMs) by incorporating external knowledge and reducing hallucinations. However, noisy or irrelevant documents are often introduced…

计算与语言 · 计算机科学 2026-01-07 Jingyu Liu , Jiaen Lin , Yong Liu

Large language models (LLMs) still struggle with multi-hop reasoning over knowledge-graphs (KGs), and we identify a previously overlooked structural reason for this difficulty: Transformer attention heads naturally specialize in distinct…

计算与语言 · 计算机科学 2026-04-15 Jinliang Liu , Jiale Bai , Shaoning Zeng