English
Related papers

Related papers: Semantic Uncertainty Quantification of Hallucinati…

200 papers

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

Computation and Language · Computer Science 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

LLMs often adopt an assertive language style also when making false claims. Such ``overconfident hallucinations'' mislead users and erode trust. Achieving the ability to express in language the actual degree of uncertainty around a claim is…

Computation and Language · Computer Science 2025-04-24 Ziwei Ji , Lei Yu , Yeskendir Koishekenov , Yejin Bang , Anthony Hartshorn , Alan Schelten , Cheng Zhang , Pascale Fung , Nicola Cancedda

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Hallucination in Large Language Models (LLMs) is a well studied problem. However, the properties that make LLM intrinsically vulnerable to hallucinations have not been identified and studied. This research identifies and characterizes the…

Computation and Language · Computer Science 2025-09-15 Naveen Lamba , Sanju Tiwari , Manas Gaur

Large language models (LLMs) hold substantial promise for clinical decision support. However, their widespread adoption in medicine, particularly in healthcare, is hindered by their propensity to generate false or misleading outputs, known…

Large Language Models (LLMs) have significantly advanced communications fields, such as Telecom Q\&A, mathematical modeling, and coding. However, LLMs encounter an inherent issue known as hallucination, i.e., generating fact-conflicting or…

Networking and Internet Architecture · Computer Science 2024-12-10 Yinqiu Liu , Guangyuan Liu , Ruichen Zhang , Dusit Niyato , Zehui Xiong , Dong In Kim , Kaibin Huang , Hongyang Du

As large language models (LLMs) are increasingly deployed in high-stakes applications, robust uncertainty estimation is essential for ensuring the safe and trustworthy deployment of LLMs. We present the most comprehensive study to date of…

Computation and Language · Computer Science 2025-06-02 Linwei Tao , Yi-Fan Yeh , Minjing Dong , Tao Huang , Philip Torr , Chang Xu

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

Computation and Language · Computer Science 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

Uncertainty quantification (UQ) methods for Large Language Models (LLMs) encompass a variety of approaches, with two major types being particularly prominent: information-based, which focus on model confidence expressed as token…

Computation and Language · Computer Science 2025-12-10 Roman Vashurin , Maiya Goloburda , Albina Ilina , Aleksandr Rubashevskii , Preslav Nakov , Artem Shelmanov , Maxim Panov

Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucination, generating plausible but factually incorrect or fabricated content, remains a critical challenge. This report provides a…

Computation and Language · Computer Science 2025-08-05 Manuel Cossio

Large language Models (LLMs) have achieved significant breakthroughs across diverse domains; however, they can still produce unreliable or misleading outputs. For responsible LLM application, Uncertainty Quantification (UQ) techniques are…

Machine Learning · Computer Science 2026-05-15 Qihao Wen , Jiahao Wang , Yang Nan , Pengfei He , Ravi Tandon , Han Xu

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

Computation and Language · Computer Science 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

Large language models (LLMs) produce outputs with varying levels of uncertainty, and, just as often, varying levels of correctness; making their practical reliability far from guaranteed. To quantify this uncertainty, we systematically…

Computation and Language · Computer Science 2025-10-24 Christian Hobelsberger , Theresa Winner , Andreas Nawroth , Oliver Mitevski , Anna-Carolina Haensch

To mitigate the impact of hallucination nature of LLMs, many studies propose detecting hallucinated generation through uncertainty estimation. However, these approaches predominantly operate at the sentence or paragraph level, failing to…

Computation and Language · Computer Science 2025-09-05 Min-Hsuan Yeh , Max Kamachee , Seongheon Park , Yixuan Li

Accurate uncertainty quantification (UQ) in Large Language Models (LLMs) is critical for trustworthy deployment. While real-world language is inherently ambiguous, reflecting aleatoric uncertainty, existing UQ methods are typically…

Machine Learning · Computer Science 2026-01-30 Tim Tomov , Dominik Fuchsgruber , Tom Wollschläger , Stephan Günnemann

Large Language Models (LLMs) are widely used to generate plausible text on online platforms, without revealing the generation process. As users increasingly encounter such black-box outputs, detecting hallucinations has become a critical…

Computation and Language · Computer Science 2026-04-08 Joosung Lee , Cheonbok Park , Hwiyeol Jo , Jeonghoon Kim , Joonsuk Park , Kang Min Yoo

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

Computation and Language · Computer Science 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

Large Language Models (LLMs) are adept at text manipulation -- tasks such as machine translation and text summarization. However, these models can also be prone to hallucination, which can be detrimental to the faithfulness of any answers…

Computation and Language · Computer Science 2024-04-04 Priyesh Vakharia , Devavrat Joshi , Meenal Chavan , Dhananjay Sonawane , Bhrigu Garg , Parsa Mazaheri

Large Language Models (LLMs) are increasingly assisting users in the real world, yet their reliability remains a concern. Uncertainty quantification (UQ) has been heralded as a tool to enhance human-LLM collaboration by enabling users to…

Computation and Language · Computer Science 2025-06-10 Siddartha Devic , Tejas Srinivasan , Jesse Thomason , Willie Neiswanger , Vatsal Sharan

Ensuring large language model (LLM) reliability requires distinguishing objective unsolvability (inherent contradictions) from subjective capability limitations (tasks exceeding model competence). Current LLMs often conflate these…

Computation and Language · Computer Science 2026-02-03 Dengyun Peng , Qiguang Chen , Bofei Liu , Jiannan Guan , Libo Qin , Zheng Yan , Jinhao Liu , Jianshu Zhang , Wanxiang Che