English
Related papers

Related papers: Understanding and Detecting Hallucinations in Neur…

200 papers

The hallucination problem of Large Language Models (LLMs) significantly limits their reliability and trustworthiness. Humans have a self-awareness process that allows us to recognize what we don't know when faced with queries. Inspired by…

Computation and Language · Computer Science 2024-10-01 Ziwei Ji , Delong Chen , Etsuko Ishii , Samuel Cahyawijaya , Yejin Bang , Bryan Wilie , Pascale Fung

Traditional language models face a challenge from hallucinations. Their very presence casts a large, dangerous shadow over the promising realm of natural language processing. It becomes crucial to understand the various kinds of…

Computation and Language · Computer Science 2025-12-03 Parth Pulkundwar , Vivek Dhanawade , Rohit Yadav , Minal Sonkar , Medha Asurlekar , Sarita Rathod

Hallucinations remain a persistent challenge for vision-language models (VLMs), which often describe nonexistent objects or fabricate facts. Existing detection methods typically operate after text generation, making intervention both costly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sai Akhil Kogilathota , Sripadha Vallabha E G , Luzhe Sun , Jiawei Zhou

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

Machine Learning · Computer Science 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Large language models (LLMs) frequently generate hallucinations -- plausible but factually incorrect outputs -- undermining their reliability. While prior work has examined hallucinations from macroscopic perspectives such as training data…

Artificial Intelligence · Computer Science 2025-12-03 Cheng Gao , Huimin Chen , Chaojun Xiao , Zhiyi Chen , Zhiyuan Liu , Maosong Sun

Hallucinations in text generation occur when the system produces text that is not grounded in the input. In this work, we tackle the problem of hallucinations in neural chart summarization. Our analysis shows that the target side of chart…

Computation and Language · Computer Science 2023-08-11 Saad Obaid ul Islam , Iza Škrjanec , Ondřej Dušek , Vera Demberg

Contextual hallucinations -- statements unsupported by given context -- remain a significant challenge in AI. We demonstrate a practical interpretability insight: a generator-agnostic observer model detects hallucinations via a single…

Machine Learning · Computer Science 2025-08-01 Charles O'Neill , Slava Chalnev , Chi Chi Zhao , Max Kirkby , Mudith Jayasekara

As large language models continue to develop in the field of AI, text generation systems are susceptible to a worrisome phenomenon known as hallucination. In this study, we summarize recent compelling insights into hallucinations in LLMs.…

Computation and Language · Computer Science 2023-09-14 Hongbin Ye , Tong Liu , Aijia Zhang , Wei Hua , Weiqiang Jia

Score-based diffusion models have achieved incredible performance in generating realistic images, audio, and video data. While these models produce high-quality samples with impressive details, they often introduce unrealistic artifacts,…

Machine Learning · Computer Science 2025-03-06 Rui Lu , Runzhe Wang , Kaifeng Lyu , Xitai Jiang , Gao Huang , Mengdi Wang

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

Computation and Language · Computer Science 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI), necessary for applied tasks like question answering and summarization. We present a series of behavioral studies on several LLM families (LLaMA,…

Computation and Language · Computer Science 2023-10-24 Nick McKenna , Tianyi Li , Liang Cheng , Mohammad Javad Hosseini , Mark Johnson , Mark Steedman

Benchmarks measure whether a model is correct. They do not measure whether a model is reliable. This distinction is largely academic for single-shot inference, but becomes critical for agentic AI systems, where a single rephrased prompt can…

Machine Learning · Computer Science 2026-01-13 Aaron R. Flouro , Shawn P. Chadwick

Hallucination, where models generate fluent text unsupported by visual evidence, remains a major flaw in vision-language models and is particularly critical in sign language translation (SLT). In SLT, meaning depends on precise grounding in…

In text generation, hallucinations refer to the generation of seemingly coherent text that contradicts established knowledge. One compelling hypothesis is that hallucinations occur when a language model is given a generation task outside…

Computation and Language · Computer Science 2024-08-21 Ameya Godbole , Nicholas Monath , Seungyeon Kim , Ankit Singh Rawat , Andrew McCallum , Manzil Zaheer

In language and vision-language models, hallucination is broadly understood as content generated from a model's prior knowledge or biases rather than from the given input. While this phenomenon has been studied in those domains, it has not…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Seyed Amir Kasaei , Mohammad Hossein Rohban

Knowledge-grounded conversational models are known to suffer from producing factually invalid statements, a phenomenon commonly called hallucination. In this work, we investigate the underlying causes of this phenomenon: is hallucination…

Computation and Language · Computer Science 2022-04-19 Nouha Dziri , Sivan Milton , Mo Yu , Osmar Zaiane , Siva Reddy

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

The increasing reliance on natural language generation (NLG) models, particularly large language models, has raised concerns about the reliability and accuracy of their outputs. A key challenge is hallucination, where models produce…

Computation and Language · Computer Science 2025-10-23 Fan Xu , Xinyu Hu , Zhenghan Yu , Li Lin , Xu Zhang , Yang Zhang , Wei Zhou , Jinjie Gu , Xiaojun Wan

We formalize hallucinations in generative models as failures to link an estimate to any plausible cause. Under this interpretation, we show that even loss-minimizing optimal estimators still hallucinate. We confirm this with a general high…

Machine Learning · Computer Science 2025-09-29 Hude Liu , Jerry Yao-Chieh Hu , Jennifer Yuntong Zhang , Zhao Song , Han Liu

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

Computation and Language · Computer Science 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko