中文
相关论文

相关论文: LUMINA: Detecting Hallucinations in RAG System wit…

200 篇论文

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

计算与语言 · 计算机科学 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Retrieval Augmented Generation (RAG) techniques aim to mitigate hallucinations in Large Language Models (LLMs). However, LLMs can still produce information that is unsupported or contradictory to the retrieved contexts. We introduce LYNX, a…

人工智能 · 计算机科学 2024-07-24 Selvan Sunitha Ravi , Bartosz Mielczarek , Anand Kannappan , Douwe Kiela , Rebecca Qian

Retrieval-Augmented Generation (RAG) aims to reduce hallucination by grounding answers in retrieved evidence, yet hallucinated answers remain common even when relevant documents are available. Existing evaluations focus on answer-level or…

计算与语言 · 计算机科学 2026-05-21 Passant Elchafei , Monorama Swain , Shahed Masoudian , Markus Schedl

Retrieval-Augmented Generation (RAG) effectively reduces hallucinations in Large Language Models (LLMs) but can still produce inconsistent or unsupported content. Although LLM-as-a-Judge is widely used for RAG hallucination detection due to…

计算与语言 · 计算机科学 2025-02-27 Zhouyu Jiang , Mengshu Sun , Zhiqiang Zhang , Lei Liang

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

计算与语言 · 计算机科学 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Retrieval Augmented Generation (RAG) systems remain vulnerable to hallucinated answers despite incorporating external knowledge sources. We present LettuceDetect a framework that addresses two critical limitations in existing hallucination…

计算与语言 · 计算机科学 2025-02-25 Ádám Kovács , Gábor Recski

Detecting hallucinations in large language models (LLMs) is critical for enhancing their reliability and trustworthiness. Most research focuses on hallucinations as deviations from information seen during training. However, the opaque…

计算与语言 · 计算机科学 2025-03-26 Fabian Ridder , Malte Schilling

Retrieval-augmented generation (RAG) aims to reduce hallucinations by grounding responses in external context, yet large language models (LLMs) still frequently introduce unsupported information or contradictions even when provided with…

Large Language Models (LLMs) have demonstrated remarkable fluency across a range of natural language tasks, yet remain vulnerable to hallucinations - factual inaccuracies that undermine trust in real world deployment. We present…

计算与语言 · 计算机科学 2025-07-16 Kaushik Dwivedi , Padmanabh Patanjali Mishra

This article surveys Evaluation models to automatically detect hallucinations in Retrieval-Augmented Generation (RAG), and presents a comprehensive benchmark of their performance across six RAG applications. Methods included in our study…

机器学习 · 计算机科学 2025-04-08 Ashish Sardana

Despite the potential of Large Language Models (LLMs) in medicine, they may generate responses lacking supporting evidence or based on hallucinated evidence. While Retrieval Augment Generation (RAG) is popular to address this issue, few…

Augmenting LLMs with context leads to improved performance across many applications. Despite much research on Retrieval Augmented Generation (RAG) systems, an open question is whether errors arise because LLMs fail to utilize the context…

计算与语言 · 计算机科学 2025-04-24 Hailey Joren , Jianyi Zhang , Chun-Sung Ferng , Da-Cheng Juan , Ankur Taly , Cyrus Rashtchian

Large Language Models (LLMs)-based question answering (QA) systems play a critical role in modern AI, demonstrating strong performance across various tasks. However, LLM-generated responses often suffer from hallucinations, unfaithful…

计算与语言 · 计算机科学 2026-01-29 Yuqing Zhao , Ziyao Liu , Yongsen Zheng , Kwok-Yan Lam

Hallucinations present a significant challenge for large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal…

计算与语言 · 计算机科学 2025-10-07 Hanxing Ding , Liang Pang , Zihao Wei , Huawei Shen , Xueqi Cheng

Retrieval-augmented generation (RAG) is a key technique for leveraging external knowledge and reducing hallucinations in large language models (LLMs). However, RAG still struggles to fully prevent hallucinated responses. To address this, it…

计算与语言 · 计算机科学 2025-02-14 Xuzhao Geng , Haozhao Wang , Jun Wang , Wei Liu , Ruixuan Li

Retrieval-augmented generation (RAG) improves large language models (LLMs) by using external knowledge to guide response generation, reducing hallucinations. However, RAG, particularly multi-modal RAG, can introduce new hallucination…

机器学习 · 计算机科学 2025-01-08 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Retrieval-augmented generation (RAG) is a framework enabling large language models (LLMs) to enhance their accuracy and reduce hallucinations by integrating external knowledge bases. In this paper, we introduce a hybrid RAG system enhanced…

计算与语言 · 计算机科学 2024-09-04 Ye Yuan , Chengwu Liu , Jingyang Yuan , Gongbo Sun , Siqi Li , Ming Zhang

Despite advancements in grounded content generation, production Large Language Models (LLMs) based applications still suffer from hallucinated answers. We present "Grounded in Context" - a member of Deepchecks' ORION (Output Reasoning-based…

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipeline's ability…