中文
相关论文

相关论文: Hallucinations Live in Variance

200 篇论文

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

机器学习 · 计算机科学 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Large language models are successful in answering factoid questions but are also prone to hallucination. We investigate the phenomenon of LLMs possessing correct answer knowledge yet still hallucinating from the perspective of inference…

计算与语言 · 计算机科学 2024-10-29 Che Jiang , Biqing Qi , Xiangyu Hong , Dayuan Fu , Yang Cheng , Fandong Meng , Mo Yu , Bowen Zhou , Jie Zhou

Large language models (LLMs) are increasingly deployed across diverse domains, yet they are prone to generating factually incorrect outputs - commonly known as "hallucinations." Among existing mitigation strategies, uncertainty-based…

计算与语言 · 计算机科学 2025-03-11 Samir Abdaljalil , Hasan Kurban , Parichit Sharma , Erchin Serpedin , Rachad Atat

We address hallucination detection in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) by framing the problem through the lens of dynamical systems stability theory. Rather than treating hallucination as a…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Bozhi Luan , Gen Li , Yalan Qin , Jifeng Guo , Yun Zhou , Faguo Wu , Hongwei Zheng , Wenjun Wu , Zhaoxin Fan

Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one must examine the underlying reasoning process. Yet existing…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Abin Shoby , Ta Duc Huy , Tuan Dung Nguyen , Minh Khoi Ho , Qi Chen , Anton van den Hengel , Phi Le Nguyen , Johan W. Verjans , Vu Minh Hieu Phan

Artificial intelligence (AI) has transformed imaging inverse problems, from medical diagnostics to Earth observation. Yet deep neural networks can produce hallucinations, realistic-looking but incorrect details, undermining their…

机器学习 · 统计学 2026-05-14 David Iagaru , Nina M. Gottschling , Anders C. Hansen , Josselin Garnier

Despite improvements in performances on different natural language generation tasks, deep neural models are prone to hallucinating facts that are incorrect or nonexistent. Different hypotheses are proposed and examined separately for…

计算与语言 · 计算机科学 2021-03-30 Yijun Xiao , William Yang Wang

In recent studies, the extensive utilization of large language models has underscored the importance of robust evaluation methodologies for assessing text generation quality and relevance to specific tasks. This has revealed a prevalent…

计算与语言 · 计算机科学 2024-03-20 Patanjali Bhamidipati , Advaith Malladi , Manish Shrivastava , Radhika Mamidi

Common evaluation paradigms for language models focus on scoring single responses through accuracy metrics or proper scoring rules, failing to capture the full richness of a model's belief state. Recent work illustrates that language models…

计算与语言 · 计算机科学 2025-10-07 Thomas F Burns

Plausible, but inaccurate, tokens in model-generated text are widely believed to be pervasive and problematic for the responsible adoption of language models. Despite this concern, there is little scientific work that attempts to measure…

计算与语言 · 计算机科学 2025-11-06 Justin D. Norman , Michael U. Rivera , D. Alex Hughes

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

计算与语言 · 计算机科学 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

机器学习 · 计算机科学 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs). To achieve this goal, we re-examine existing detection approaches based on the self-consistency of LMs and uncover two…

计算与语言 · 计算机科学 2024-02-20 Jiaxin Zhang , Zhuohang Li , Kamalika Das , Bradley A. Malin , Sricharan Kumar

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Hallucinations in automatic speech recognition (ASR) systems refer to fluent and coherent transcriptions produced by neural ASR models that are completely unrelated to the underlying acoustic input (i.e., the speech signal). While similar…

计算与语言 · 计算机科学 2025-10-21 Alkis Koudounas , Moreno La Quatra , Manuel Giollo , Sabato Marco Siniscalchi , Elena Baralis

Large Language Models (LLMs) suffer from hallucination problems, which hinder their reliability in sensitive applications. In the black-box setting, several self-consistency-based techniques have been proposed for hallucination detection.…

计算与语言 · 计算机科学 2025-02-25 Yihao Xue , Kristjan Greenewald , Youssef Mroueh , Baharan Mirzasoleiman

Contextual hallucinations -- statements unsupported by given context -- remain a significant challenge in AI. We demonstrate a practical interpretability insight: a generator-agnostic observer model detects hallucinations via a single…

机器学习 · 计算机科学 2025-08-01 Charles O'Neill , Slava Chalnev , Chi Chi Zhao , Max Kirkby , Mudith Jayasekara

Large language models generate outputs stochastically and may produce fluent but invalid responses, including factual hallucinations. Existing mitigation strategies reduce average error rates but do not provide explicit control over the…

机器学习 · 计算机科学 2026-02-03 Sreenivasan Mohandas

Hallucination remains a central failure mode of large language models, but existing benchmarks operationalize it inconsistently across summarization, question answering, retrieval-augmented generation, and agentic interaction. This…

计算与语言 · 计算机科学 2026-05-20 Emmy Liu , Varun Gangal , Michael Yu , Zhuofu Tao , Karan Singh , Sachin Kumar , Steven Y. Feng

Hallucinations in large language models (LLMs) are outputs that are syntactically coherent but factually incorrect or contextually inconsistent. They are persistent obstacles in high-stakes industrial settings such as engineering design,…

软件工程 · 计算机科学 2026-04-07 Brian Freeman , Adam Kicklighter , Matt Erdman , Zach Gordon