English
Related papers

Related papers: Semantic Uncertainty Quantification of Hallucinati…

200 papers

Large Language Models (LLMs) are prone to hallucination with non-factual or unfaithful statements, which undermines the applications in real-world scenarios. Recent researches focus on uncertainty-based hallucination detection, which…

Computation and Language · Computer Science 2025-04-08 Kedi Chen , Qin Chen , Jie Zhou , Xinqi Tao , Bowen Ding , Jingwen Xie , Mingchen Xie , Peilong Li , Feng Zheng , Liang He

Large Language Models (LLMs) are known to produce very high-quality tests and responses to our queries. But how much can we trust this generated text? In this paper, we study the problem of uncertainty quantification in LLMs. We propose a…

Computation and Language · Computer Science 2025-04-28 Muhammad Mubashar , Shireen Kudukkil Manchingal , Fabio Cuzzolin

Large language models (LLMs) have demonstrated remarkable performance across diverse tasks by encoding vast amounts of factual knowledge. However, they are still prone to hallucinations, generating incorrect or misleading information, often…

Computation and Language · Computer Science 2025-11-13 Xiaomin Li , Zhou Yu , Ziji Zhang , Yingying Zhuang , Swair Shah , Narayanan Sadagopan , Anurag Beniwal

Large language models have shown impressive capabilities in code generation, yet they often produce functionally incorrect code. Uncertainty quantification (UQ) methods have emerged as a promising approach for detecting hallucinations in…

Computation and Language · Computer Science 2026-05-28 Dylan Bouchard , Mohit Singh Chauhan , Zeya Ahmad , Ho-Kyeong Ra

Hallucinations, defined as instances where Large Language Models (LLMs) generate false or misleading content, pose a significant challenge that impacts the safety and trust of downstream applications. We introduce UQLM, a Python package for…

Computation and Language · Computer Science 2026-03-05 Dylan Bouchard , Mohit Singh Chauhan , David Skarbrevik , Ho-Kyeong Ra , Viren Bajaj , Zeya Ahmad

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

Machine Learning · Computer Science 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Hallucinations are a common issue that undermine the reliability of large language models (LLMs). Recent studies have identified a specific subset of hallucinations, known as confabulations, which arise due to predictive uncertainty of…

Machine Learning · Computer Science 2025-10-24 Mykyta Ielanskyi , Kajetan Schweighofer , Lukas Aichberger , Sepp Hochreiter

With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and…

Computation and Language · Computer Science 2024-11-04 Xin Qiu , Risto Miikkulainen

Large Language Models (LLMs) have become powerful, but hallucinations remain a vital obstacle to their trustworthy use. Previous works improved the capability of hallucination detection by measuring uncertainty. But they can not explain the…

Computation and Language · Computer Science 2026-02-03 Yiming Huang , Junyan Zhang , Zihao Wang , Biquan Bie , Yunzhong Qiu , Xuming Hu , Yi R. Fung , Xinlei He

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

Computation and Language · Computer Science 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Large language models (LLMs) have revolutionized the field of natural language processing with their impressive reasoning and question-answering capabilities. However, these models are sometimes prone to generating credible-sounding but…

Computation and Language · Computer Science 2026-04-21 Ranganath Krishnan , Piyush Khanna , Omesh Tickoo

Hallucinations pose a significant challenge to the reliability and alignment of Large Language Models (LLMs), limiting their widespread acceptance beyond chatbot applications. Despite ongoing efforts, hallucinations remain a prevalent…

Computation and Language · Computer Science 2024-02-27 Cem Uluoglakci , Tugba Taskaya Temizel

Large language models (LLMs) are highly effective in various natural language processing (NLP) tasks. However, they are susceptible to producing unreliable conjectures in ambiguous contexts called hallucination. This paper presents a new…

Computation and Language · Computer Science 2024-03-07 Yuhong Sun , Zhangyue Yin , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Hui Zhao

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

Computation and Language · Computer Science 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Uncertainty quantification in Large Language Models (LLMs) is crucial for applications where safety and reliability are important. In particular, uncertainty can be used to improve the trustworthiness of LLMs by detecting factually…

Machine Learning · Computer Science 2024-05-31 Alexander Nikitin , Jannik Kossen , Yarin Gal , Pekka Marttinen

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

Computation and Language · Computer Science 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

The rapid advancement of large language model(LLM) technology has facilitated its integration into various domains of professional and daily life. However, the persistent challenge of LLM hallucination has emerged as a critical limitation,…

Computation and Language · Computer Science 2026-01-05 Yuhao Zhang , Zhongliang Yang , Linna Zhou

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

Computation and Language · Computer Science 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko