中文
相关论文

相关论文: Real-Time Evaluation Models for RAG: Who Detects H…

200 篇论文

Methods to evaluate Large Language Model (LLM) responses and detect inconsistencies, also known as hallucinations, with respect to the provided knowledge, are becoming increasingly important for LLM applications. Current metrics fall short…

计算与语言 · 计算机科学 2024-07-16 Hannah Sansford , Nicholas Richardson , Hermina Petric Maretic , Juba Nait Saada

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

计算与语言 · 计算机科学 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Hallucinations pose a significant obstacle to the reliability and widespread adoption of language models, yet their accurate measurement remains a persistent challenge. While many task- and domain-specific metrics have been proposed to…

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

机器学习 · 计算机科学 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection. To overcome this issue, we propose a novel framework that leverages a small language…

计算与语言 · 计算机科学 2024-08-26 Mengya Hu , Rui Xu , Deren Lei , Yaxi Li , Mingyu Wang , Emily Ching , Eslam Kamal , Alex Deng

Uncertainty estimation is a necessary component when implementing AI in high-risk settings, such as autonomous cars, medicine, or insurances. Large Language Models (LLMs) have seen a surge in popularity in recent years, but they are subject…

机器学习 · 计算机科学 2024-12-09 Gabriel Y. Arteaga , Thomas B. Schön , Nicolas Pielawski

Large Language Models (LLMs) have shown their ability to collaborate effectively with humans in real-world scenarios. However, LLMs are apt to generate hallucinations, i.e., makeup incorrect text and unverified information, which can cause…

计算与语言 · 计算机科学 2023-10-25 Shiping Yang , Renliang Sun , Xiaojun Wan

Retrieval-Augmented Generation (RAG) is a powerful approach that enables large language models (LLMs) to incorporate external knowledge. However, evaluating the effectiveness of RAG systems in specialized scenarios remains challenging due…

计算与语言 · 计算机科学 2025-03-05 Kunlun Zhu , Yifan Luo , Dingling Xu , Yukun Yan , Zhenghao Liu , Shi Yu , Ruobing Wang , Shuo Wang , Yishan Li , Nan Zhang , Xu Han , Zhiyuan Liu , Maosong Sun

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

计算与语言 · 计算机科学 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko

Medical question-answering (QA) systems can benefit from advances in large language models (LLMs), but directly applying LLMs to the clinical domain poses challenges such as maintaining factual accuracy and avoiding hallucinations. In this…

计算与语言 · 计算机科学 2025-12-08 Tasnimul Hassan , Md Faisal Karim , Haziq Jeelani , Elham Behnam , Robert Green , Fayeq Jeelani Syed

The emergence of Large Language Models (LLMs) has revolutionized how users access information, shifting from traditional search engines to direct question-and-answer interactions with LLMs. However, the widespread adoption of LLMs has…

计算与语言 · 计算机科学 2024-07-23 Weihang Su , Yichen Tang , Qingyao Ai , Changyue Wang , Zhijing Wu , Yiqun Liu

Retrieval-Augmented Generation (RAG) has quickly grown into a pivotal paradigm in the development of Large Language Models (LLMs). Although existing research mainly emphasizes accuracy and efficiency, the trustworthiness of RAG systems…

Retrieval-augmented generation (RAG) has shown impressive capabilities in mitigating hallucinations in large language models (LLMs). However, LLMs struggle to maintain consistent reasoning when exposed to misleading or conflicting evidence,…

人工智能 · 计算机科学 2026-01-21 Linda Zeng , Rithwik Gupta , Divij Motwani , Yi Zhang , Diji Yang

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

计算与语言 · 计算机科学 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Multi-modal Large Language Models (MLLMs) have emerged as a powerful paradigm for integrating visual and textual information, supporting a wide range of multi-modal tasks. However, these models often suffer from hallucination, producing…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Zhiyuan Chen , Yuecong Min , Jie Zhang , Bei Yan , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

In real-world applications, Large Language Models (LLMs) often hallucinate, even in Retrieval-Augmented Generation (RAG) settings, which poses a significant challenge to their deployment. In this paper, we introduce AggTruth, a method for…

I combine detection and mitigation techniques to addresses hallucinations in Large Language Models (LLMs). Mitigation is achieved in a question-answering Retrieval-Augmented Generation (RAG) framework while detection is obtained by…

计算与语言 · 计算机科学 2026-01-01 Maria Paola Priola

Hallucination has emerged as a significant barrier to the effective application of Large Language Models (LLMs). In this work, we introduce a novel Attention-Guided SElf-Reflection (AGSER) approach for zero-shot hallucination detection in…

计算与语言 · 计算机科学 2025-09-04 Qiang Liu , Xinlong Chen , Yue Ding , Bowen Song , Weiqiang Wang , Shu Wu , Liang Wang

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

机器学习 · 计算机科学 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Hallucinations pose a significant challenge to the reliability and alignment of Large Language Models (LLMs), limiting their widespread acceptance beyond chatbot applications. Despite ongoing efforts, hallucinations remain a prevalent…

计算与语言 · 计算机科学 2024-02-27 Cem Uluoglakci , Tugba Taskaya Temizel