中文
相关论文

相关论文: Is LLMs Hallucination Usable? LLM-based Negative R…

200 篇论文

We show that LLMs hallucinate because their output is not constrained to be synonymous with claims for which they have evidence: a condition that we call evidential closure. Information about the truth or falsity of sentences is not…

计算与语言 · 计算机科学 2023-10-25 Adam Bouyamourn

A common approach to hallucination detection casts it as a natural language inference (NLI) task, often using LLMs to classify whether the generated text is entailed by corresponding reference texts. Since entailment classification is a…

计算与语言 · 计算机科学 2025-06-06 Ron Eliav , Arie Cattan , Eran Hirsch , Shahaf Bassan , Elias Stengel-Eskin , Mohit Bansal , Ido Dagan

LLMs are often claimed to be capable of Natural Language Inference (NLI), which is widely regarded as a cornerstone of more complex forms of reasoning. However, recent works show that LLMs still suffer from hallucinations in NLI due to…

计算与语言 · 计算机科学 2025-03-17 Liang Cheng , Tianyi Li , Zhaowei Wang , Tianyang Liu , Mark Steedman

With the widespread adoption of large language models (LLMs), hallucinations, which are non-factual fabrications in model outputs, have become serious concerns. Reasoning capabilities have received attention as a self-verification process…

计算与语言 · 计算机科学 2026-01-06 Junichiro Niimi

Reasoning has become a central paradigm for large language models (LLMs), consistently boosting accuracy across diverse benchmarks. Yet its suitability for precision-sensitive tasks remains unclear. We present the first systematic study of…

The Retrieval-augmented generation (RAG) system based on Large language model (LLM) has made significant progress. It can effectively reduce factuality hallucinations, but faithfulness hallucinations still exist. Previous methods for…

计算与语言 · 计算机科学 2026-01-07 Jianpeng Hu , Yanzeng Li , Jialun Zhong , Wenfa Qi , Lei Zou

The hallucination problem of Large Language Models (LLMs) significantly limits their reliability and trustworthiness. Humans have a self-awareness process that allows us to recognize what we don't know when faced with queries. Inspired by…

计算与语言 · 计算机科学 2024-10-01 Ziwei Ji , Delong Chen , Etsuko Ishii , Samuel Cahyawijaya , Yejin Bang , Bryan Wilie , Pascale Fung

LLM deployment in critical domains is currently impeded by persistent hallucinations--generating plausible but factually incorrect assertions. While scaling laws drove significant improvements in general capabilities, theoretical frameworks…

机器学习 · 计算机科学 2026-01-29 Jiayun Wu , Jiashuo Liu , Zhiyuan Zeng , Tianyang Zhan , Tianle Cai , Wenhao Huang

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

计算与语言 · 计算机科学 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Large language models (LLMs) can be prone to hallucinations - generating unreliable outputs that are unfaithful to their inputs, external facts or internally inconsistent. In this work, we address several challenges for post-hoc…

计算与语言 · 计算机科学 2024-08-12 Simon Valentin , Jinmiao Fu , Gianluca Detommaso , Shaoyuan Xu , Giovanni Zappella , Bryan Wang

Large language models (LLMs) are prone to hallucinations, i.e., statements unsupported by the input or training data, hindering reliable deployment. In parallel, numerous uncertainty estimation (UE) methods have been proposed to quantify…

计算与语言 · 计算机科学 2026-05-27 Yedidia Agnimo , Anna Korba , Annabelle Blangero , Nicolas Chesneau , Karteek Alahari

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

计算与语言 · 计算机科学 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

State-of-the-art abstractive summarization systems often generate \emph{hallucinations}; i.e., content that is not directly inferable from the source text. Despite being assumed incorrect, we find that much hallucinated content is factual,…

计算与语言 · 计算机科学 2021-12-07 Meng Cao , Yue Dong , Jackie Chi Kit Cheung

While large language models (LLMs) have demonstrated exceptional performance across various tasks following human alignment, they may still generate responses that sound plausible but contradict factual knowledge, a phenomenon known as…

计算与语言 · 计算机科学 2024-09-24 Fanqi Wan , Xinting Huang , Leyang Cui , Xiaojun Quan , Wei Bi , Shuming Shi

The contemporary LLMs are prone to producing hallucinations, stemming mainly from the knowledge gaps within the models. To address this critical limitation, researchers employ diverse strategies to augment the LLMs by incorporating external…

计算与语言 · 计算机科学 2024-03-19 Garima Agrawal , Tharindu Kumarage , Zeyad Alghamdi , Huan Liu

Hallucinations of vision-language models (VLMs), which are misalignments between visual content and generated text, undermine the reliability of VLMs. One common approach for detecting them employs the same VLM, or a different one, to…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Ofir Azachi , Kfir Eliyahu , Eyal El Ani , Rom Himelstein , Roi Reichart , Yuval Pinter , Nitay Calderon

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

人工智能 · 计算机科学 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

计算与语言 · 计算机科学 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Hallucination in large language models (LLMs) during long-form generation remains difficult to address under existing reinforcement learning from human feedback (RLHF) frameworks, as their preference rewards often overlook the model's own…

计算与语言 · 计算机科学 2026-05-08 Junliang Li , Yucheng Wang , Yan Chen , Yu Ran , Ruiqing Zhang , Jing Liu , Hua Wu , Haifeng Wang