English
Related papers

Related papers: Rethinking Hallucinations: Correctness, Consistenc…

200 papers

Large Language Models (LLMs) are prone to generating plausible yet incorrect responses, known as hallucinations. Effectively detecting hallucinations is therefore crucial for the safe deployment of LLMs. Recent research has linked…

Computation and Language · Computer Science 2026-03-03 Litian Liu , Reza Pourreza , Sunny Panchal , Apratim Bhattacharyya , Yubing Jian , Yao Qin , Roland Memisevic

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

Machine Learning · Computer Science 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Hallucinations pose a significant obstacle to the reliability and widespread adoption of language models, yet their accurate measurement remains a persistent challenge. While many task- and domain-specific metrics have been proposed to…

Computation and Language · Computer Science 2025-10-10 Atharva Kulkarni , Yuan Zhang , Joel Ruben Antony Moniz , Xiou Ge , Bo-Hsiang Tseng , Dhivya Piraviperumal , Swabha Swayamdipta , Hong Yu

Large Language Models often generate factually incorrect but plausible outputs, known as hallucinations. We identify a more insidious phenomenon, LLM delusion, defined as high belief hallucinations, incorrect outputs with abnormally high…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zixv yang , Zichen Zhu , Kunyao Lan , Zihan Wang , Mengyue Wu , Ziwei Ji , Lu Chen , Pascale Fung , Kai Yu

Hallucination, a phenomenon where large language models (LLMs) produce output that is factually incorrect or unrelated to the input, is a major challenge for LLM applications that require accuracy and dependability. In this paper, we…

Computation and Language · Computer Science 2025-04-01 Song Wang , Xun Wang , Jie Mei , Yujia Xie , Sean Muarray , Zhang Li , Lingfeng Wu , Si-Qing Chen , Wayne Xiong

Large Language Models (LLMs) have become powerful, but hallucinations remain a vital obstacle to their trustworthy use. Previous works improved the capability of hallucination detection by measuring uncertainty. But they can not explain the…

Computation and Language · Computer Science 2026-02-03 Yiming Huang , Junyan Zhang , Zihao Wang , Biquan Bie , Yunzhong Qiu , Xuming Hu , Yi R. Fung , Xinlei He

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

Computation and Language · Computer Science 2025-08-01 Esmail Gumaan

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

Computation and Language · Computer Science 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

Computation and Language · Computer Science 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Large language models (LLMs) often generate inaccurate yet credible-sounding content, known as hallucinations. This inherent feature of LLMs poses significant risks, especially in critical domains. I analyze LLMs as a new class of…

General Economics · Economics 2025-03-10 Tingmingke Lu

Large Language Models (LLMs) are increasingly applied to medical imaging tasks, including image interpretation and synthetic image generation. However, these models often produce hallucinations, which are confident but incorrect outputs…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Anindya Bijoy Das , Shahnewaz Karim Sakib , Shibbir Ahmed

Prior work on large language model (LLM) hallucinations has associated them with model uncertainty or inaccurate knowledge. In this work, we define and investigate a distinct type of hallucination, where a model can consistently answer a…

Computation and Language · Computer Science 2025-08-26 Adi Simhi , Itay Itzhak , Fazl Barez , Gabriel Stanovsky , Yonatan Belinkov

Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs. To measure the level of hallucination of LLMs, previous works…

Artificial Intelligence · Computer Science 2023-09-12 Li Du , Yequan Wang , Xingrun Xing , Yiqun Ya , Xiang Li , Xin Jiang , Xuezhi Fang

Large Language Models (LLMs) suffer from hallucination problems, which hinder their reliability in sensitive applications. In the black-box setting, several self-consistency-based techniques have been proposed for hallucination detection.…

Computation and Language · Computer Science 2025-02-25 Yihao Xue , Kristjan Greenewald , Youssef Mroueh , Baharan Mirzasoleiman

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

Computation and Language · Computer Science 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Large Language Models (LLMs) exhibit remarkable capabilities in natural language understanding and reasoning, but suffer from hallucination: the generation of factually incorrect content. While numerous methods have been developed to reduce…

Computation and Language · Computer Science 2026-01-22 Mohor Banerjee , Nadya Yuki Wangsajaya , Syed Ali Redha Alsagoff , Min Sen Tan , Zachary Choy Kit Chun , Alvin Chan Guo Wei

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

Computation and Language · Computer Science 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…