中文
相关论文

相关论文: INTRYGUE: Induction-Aware Entropy Gating for Relia…

200 篇论文

RL training of multi-turn LLM agents is inherently unstable, and reasoning quality directly determines task performance. Entropy is widely used to track reasoning stability. However, entropy only measures diversity within the same input,…

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

计算与语言 · 计算机科学 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Retrieval-Augmented Generation (RAG) systems implicitly assume mutual consistency among retrieved documents -- an assumption that frequently fails in practice. We present ConflictRAG, a conflict-aware RAG framework that detects, classifies,…

计算与语言 · 计算机科学 2026-05-19 Chenyu Wang , Yingmin Liu , Yang Shu

Although the Retrieval-Augmented Generation (RAG) paradigms can use external knowledge to enhance and ground the outputs of Large Language Models (LLMs) to mitigate generative hallucinations and static knowledge base problems, they still…

计算与语言 · 计算机科学 2024-05-24 Diji Yang , Jinmeng Rao , Kezhen Chen , Xiaoyuan Guo , Yawen Zhang , Jie Yang , Yi Zhang

Accurate and reliable knowledge retrieval is vital for financial question-answering, where continually updated data sources and complex, high-stakes contexts demand precision. Traditional retrieval systems rely on a single database and…

Retrieval Augmented Generation (RAG) complements the knowledge of Large Language Models (LLMs) by leveraging external information to enhance response accuracy for queries. This approach is widely applied in several fields by taking its…

Retriever-augmented generation (RAG) has become a widely adopted approach for enhancing the factual accuracy of large language models (LLMs). While current benchmarks evaluate the performance of RAG methods from various perspectives, they…

信息检索 · 计算机科学 2025-04-08 Kepu Zhang , Zhongxiang Sun , Weijie Yu , Xiaoxue Zang , Kai Zheng , Yang Song , Han Li , Jun Xu

Large Language Models (LLMs) demonstrate strong reasoning capabilities but struggle with hallucinations and limited transparency. Recently, KG-enhanced LLMs that integrate knowledge graphs (KGs) have been shown to improve reasoning…

人工智能 · 计算机科学 2025-12-10 Minbae Park , Hyemin Yang , Jeonghyun Kim , Kunsoo Park , Hyunjoon Kim

The integration of Large Language Models (LLMs) into various applications has driven the need for structured and reliable responses. A key challenge in Retrieval-Augmented Generation (RAG) systems is ensuring that outputs align with…

计算与语言 · 计算机科学 2025-09-09 Özgür Uğur , Musa Yılmaz , Esra Şavirdi , Özay Ezerceli , Mahmut El Huseyni , Selva Taş , Reyhan Bayraktar

Retrieval-augmented generation (RAG) is a key technique for leveraging external knowledge and reducing hallucinations in large language models (LLMs). However, RAG still struggles to fully prevent hallucinated responses. To address this, it…

计算与语言 · 计算机科学 2025-02-14 Xuzhao Geng , Haozhao Wang , Jun Wang , Wei Liu , Ruixuan Li

When applied to open-domain question answering, large language models (LLMs) frequently generate incorrect responses based on made-up facts, which are called $\textit{hallucinations}$. Retrieval augmented generation (RAG) is a promising…

计算与语言 · 计算机科学 2024-04-09 Shuo Li , Sangdon Park , Insup Lee , Osbert Bastani

Uncertainty estimation is important for deploying LLMs in high-stakes applications such as healthcare and finance, where hallucinations can appear fluent and plausible while being factually incorrect, making it difficult for users to judge…

机器学习 · 计算机科学 2026-05-08 Mingcheng Zhu , Yu Liu , Tingting Zhu

The rise of generative AI, has driven significant advancements in high-risk sectors like healthcare and finance. The Retrieval-Augmented Generation (RAG) architecture, combining language models (LLMs) with search engines, is particularly…

Retrieval-Augmented Generation (RAG) systems have gained widespread adoption by application builders because they leverage sources of truth to enable Large Language Models (LLMs) to generate more factually sound responses. However,…

计算与语言 · 计算机科学 2025-05-09 Alex Shan , John Bauer , Christopher D. Manning

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

计算与语言 · 计算机科学 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen

With the rapid advancement of large language models (LLMs), retrieval-augmented generation (RAG) has emerged as a critical approach to supplement the inherent knowledge limitations of LLMs. However, due to the typically large volume of…

计算与语言 · 计算机科学 2025-11-11 Yuhao Wang , Ruiyang Ren , Yucheng Wang , Jing Liu , Wayne Xin Zhao , Hua Wu , Haifeng Wang

Recent advancements in large language models (LLMs) often rely on generating intermediate reasoning steps to enhance accuracy. However, little work has examined how reasoning utility contributes to the final answer's correctness. Due to the…

计算与语言 · 计算机科学 2025-08-29 Xu Guo

Retrieval-Augmented Generation (RAG) has become a key paradigm for reducing factual hallucinations in Large Language Models (LLMs), yet little is known about how the order of retrieved documents affects model behavior. We empirically show…

计算与语言 · 计算机科学 2026-04-22 Qianchi Zhang , Hainan Zhang , Liang Pang , Hongwei Zheng , Zhiming Zheng

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

人工智能 · 计算机科学 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Retrieval-augmented generation (RAG) systems can effectively mitigate the hallucination problem of large language models (LLMs),but they also possess inherent vulnerabilities. Identifying these weaknesses before the large-scale real-world…

信息检索 · 计算机科学 2025-05-23 Hongru Song , Yu-an Liu , Ruqing Zhang , Jiafeng Guo , Yixing Fan