English
Related papers

Related papers: Semantic Entropy Probes: Robust and Cheap Hallucin…

200 papers

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

Artificial Intelligence · Computer Science 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Large Language Models (LLMs) are prone to hallucination with non-factual or unfaithful statements, which undermines the applications in real-world scenarios. Recent researches focus on uncertainty-based hallucination detection, which…

Computation and Language · Computer Science 2025-04-08 Kedi Chen , Qin Chen , Jie Zhou , Xinqi Tao , Bowen Ding , Jingwen Xie , Mingchen Xie , Peilong Li , Feng Zheng , Liang He

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

Computation and Language · Computer Science 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

Hallucinations in Large Language Models (LLMs) pose a major barrier to their reliable use in critical decision-making. Although existing hallucination detection methods have improved accuracy, they still struggle with disentangling semantic…

Computation and Language · Computer Science 2026-04-02 Junjie Hu , Gang Tu , ShengYu Cheng , Jinxin Li , Jinting Wang , Rui Chen , Zhilong Zhou , Dongbo Shan

Despite the outstanding performance of large language models (LLMs) across various NLP tasks, hallucinations in LLMs--where LLMs generate inaccurate responses--remains as a critical problem as it can be directly connected to a crisis of…

Computation and Language · Computer Science 2025-07-22 Minsuh Joo , Hyunsoo Cho

Sampling multiple candidate programs at inference time is an effective way to improve LLM code generation. However, its benefit depends on reliably selecting a correct solution from the generated pool. We observe that this selection problem…

Machine Learning · Computer Science 2026-05-13 David Cho , Yifan Wang , Fanping Sui , Ananth Grama

Large Language Models (LLMs) are increasingly deployed in high-risk domains. However, state-of-the-art LLMs often exhibit hallucinations, raising serious concerns about their reliability. Prior work has explored adversarial attacks to…

Computation and Language · Computer Science 2026-02-17 Buyun Liang , Liangzu Peng , Jinqi Luo , Darshan Thaker , Kwan Ho Ryan Chan , René Vidal

Large Language Models (LLMs) are prone to generating plausible yet incorrect responses, known as hallucinations. Effectively detecting hallucinations is therefore crucial for the safe deployment of LLMs. Recent research has linked…

Computation and Language · Computer Science 2026-03-03 Litian Liu , Reza Pourreza , Sunny Panchal , Apratim Bhattacharyya , Yubing Jian , Yao Qin , Roland Memisevic

Evaluating faithfulness of Large Language Models (LLMs) to a given task is a complex challenge. We propose two new unsupervised metrics for faithfulness evaluation using insights from information theory and thermodynamics. Our approach…

Artificial Intelligence · Computer Science 2025-12-09 Igor Halperin

While Large Language Models (LLMs) have demonstrated remarkable capabilities, their reliability is significantly compromised by hallucinations. Existing intrinsic self-correction methods attempt to address this, but often fail due to…

Computation and Language · Computer Science 2026-05-29 Gyumin Kim , Juhwan Park , Jaeha Kim , Seunggyun Han , Kyungrak Son , Ikbeom Jang

Language models, particularly generative models, are susceptible to hallucinations, generating outputs that contradict factual knowledge or the source text. This study explores methods for detecting hallucinations in three SemEval-2024 Task…

Identification of hallucination spans in black-box language model generated text is essential for applications in the real world. A recent attempt at this direction is SemEval-2025 Task 3, Mu-SHROOM-a Multilingual Shared Task on…

Computation and Language · Computer Science 2025-05-26 Saketh Reddy Vemula , Parameswari Krishnamurthy

Large language models (LLMs) produce fluent but unsupported answers - hallucinations - limiting safe deployment in high-stakes domains. We propose ECLIPSE, a framework that treats hallucination as a mismatch between a model's semantic…

Machine Learning · Computer Science 2025-12-04 Mainak Singha

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

LLMs' overconfidence, particularly when hallucinating, poses a significant challenge for the deployment of the models in safety-critical settings and makes a reliable estimation of uncertainty necessary. Existing approaches for uncertainty…

Machine Learning · Computer Science 2026-05-26 Hamed Karimi , Vaishali Meyappan , Reza Samavi

To determine whether using discrete semantic entropy (DSE) to reject questions likely to generate hallucinations can improve the accuracy of black-box vision-language models (VLMs) in radiologic image based visual question answering (VQA).…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Patrick Wienholt , Sophie Caselitz , Robert Siepmann , Philipp Bruners , Keno Bressem , Christiane Kuhl , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn

Recent advancements in multimodal large reasoning models (MLRMs) have significantly improved performance in visual question answering. However, we observe that transition words (e.g., because, however, and wait) are closely associated with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhongxing Xu , Zhonghua Wang , Zhe Qian , Dachuan Shi , Feilong Tang , Ming Hu , Shiyan Su , Xiaocheng Zou , Wei Feng , Dwarikanath Mahapatra , Yifan Peng , Mingquan Lin , Zongyuan Ge

Small language models (SLMs) have been increasingly deployed in edge devices and other resource-constrained settings. However, these models make confident mispredictions and produce unstable output, making them risky for factual and…

Artificial Intelligence · Computer Science 2026-04-07 Adeyemi Adeseye , Aisvarya Adeseye , Hannu Tenhunen , Jouni Isoaho

Large Language Models (LLMs) achieve strong performance across many tasks but suffer from high inference latency due to autoregressive decoding. The issue is exacerbated in Large Reasoning Models (LRMs), which generate lengthy chains of…

Computation and Language · Computer Science 2026-02-05 Ximing Dong , Shaowei Wang , Dayi Lin , Boyuan Chen , Ahmed E. Hassan

Large language models frequently exhibit hallucinations: fluent and confident outputs that are factually incorrect or unsupported by the input context. While recent hallucination detection methods have explored various features derived from…

Computation and Language · Computer Science 2026-04-14 Jakub Binkowski , Kamil Adamczewski , Tomasz Kajdanowicz