English
Related papers

Related papers: Semantic Entropy Probes: Robust and Cheap Hallucin…

200 papers

Recently proliferated deep learning-based semantic communications (DLSC) focus on how transmitted symbols efficiently convey a desired meaning to the destination. However, the sensitivity of neural models and the openness of wireless…

Cryptography and Security · Computer Science 2024-12-02 Yankai Rong , Guoshun Nan , Minwei Zhang , Sihan Chen , Songtao Wang , Xuefei Zhang , Nan Ma , Shixun Gong , Zhaohui Yang , Qimei Cui , Xiaofeng Tao , Tony Q. S. Quek

Uncertainty quantification (UQ) for open-ended language generation remains a critical yet underexplored challenge, especially under black-box constraints where internal model signals are inaccessible. In this paper, we introduce…

Computation and Language · Computer Science 2025-09-08 Beining Xu , Yongming Lu

Large Language Models (LLMs) have become widely used for Software Engineering (SE) tasks, spanning from function-level code generation to complex repository-level workflows. However, the high latency of autoregressive inference remains a…

Software Engineering · Computer Science 2026-05-05 Yijia Li , Junkai Chen , Xing Hu , Xin Xia

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks. However, the truthfulness of their outputs is not guaranteed, and their tendency toward overconfidence further limits reliability. Uncertainty…

Computation and Language · Computer Science 2026-03-23 Qi Cao , Andrew Gambardella , Takeshi Kojima , Yutaka Matsuo , Yusuke Iwasawa

Hallucinations are a common issue that undermine the reliability of large language models (LLMs). Recent studies have identified a specific subset of hallucinations, known as confabulations, which arise due to predictive uncertainty of…

Machine Learning · Computer Science 2025-10-24 Mykyta Ielanskyi , Kajetan Schweighofer , Lukas Aichberger , Sepp Hochreiter

Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination Assessment via Log-probs as Time series), a lightweight hallucination detector that leverages…

Computation and Language · Computer Science 2026-02-04 Ahmad Shapiro , Karan Taneja , Ashok Goel

Probabilistic embeddings have several advantages over deterministic embeddings as they map each data point to a distribution, which better describes the uncertainty and complexity of data. Many works focus on adjusting the distribution…

Artificial Intelligence · Computer Science 2024-12-16 Xiang Huang , Hao Peng , Li Sun , Hui Lin , Chunyang Liu , Jiang Cao , Philip S. Yu

With the large-scale adoption of Large Language Models (LLMs) in various applications, there is a growing reliability concern due to their tendency to generate inaccurate text, i.e. hallucinations. In this work, we propose Cross-Layer…

Computation and Language · Computer Science 2025-09-15 Malavika Suresh , Rahaf Aljundi , Ikechukwu Nkisi-Orji , Nirmalie Wiratunga

Explaining stock predictions is generally a difficult task for traditional non-generative deep learning models, where explanations are limited to visualizing the attention weights on important texts. Today, Large Language Models (LLMs)…

Machine Learning · Computer Science 2024-03-01 Kelvin J. L. Koa , Yunshan Ma , Ritchie Ng , Tat-Seng Chua

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

Computation and Language · Computer Science 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

Hallucination, a phenomenon where large language models (LLMs) produce output that is factually incorrect or unrelated to the input, is a major challenge for LLM applications that require accuracy and dependability. In this paper, we…

Computation and Language · Computer Science 2025-04-01 Song Wang , Xun Wang , Jie Mei , Yujia Xie , Sean Muarray , Zhang Li , Lingfeng Wu , Si-Qing Chen , Wayne Xiong

Recent audio-aware large language models (ALLMs) have demonstrated strong capabilities across diverse audio understanding and reasoning tasks, but they still frequently produce hallucinated or overly confident outputs. While uncertainty…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Vision-Language Models (VLMs) excel at multimodal tasks, but they remain vulnerable to hallucinations that are factually incorrect or ungrounded in the input image. Recent work suggests that hallucination detection using internal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ryuhei Miyazato , Shunsuke Kitada , Kei Harada

Hallucinations are one of the major issues affecting LLMs, hindering their wide adoption in production systems. While current research solutions for detecting hallucinations are mainly based on heuristics, in this paper we introduce a…

Computation and Language · Computer Science 2025-02-14 Emanuele Ricco , Lorenzo Cima , Roberto Di Pietro

As language models (LMs) deliver increasing performance on a range of NLP tasks, probing classifiers have become an indispensable technique in the effort to better understand their inner workings. A typical setup involves (1) defining an…

Computation and Language · Computer Science 2024-08-01 Charles Jin , Martin Rinard

Speculative decoding (SD) accelerates large language model (LLM) reasoning by using a small draft model to generate candidate tokens, which the target LLM either accepts directly or regenerates upon rejection. However, excessive alignment…

Computation and Language · Computer Science 2026-01-01 Tiancheng Su , Meicong Zhang , Guoxiu He

Hallucinations in Speech Large Language Models (SpeechLLMs) pose significant risks, yet existing detection methods typically rely on gold-standard outputs that are costly or impractical to obtain. Moreover, hallucination detection methods…

Computation and Language · Computer Science 2026-04-22 Jonas Waldendorf , Bashar Awwad Shiekh Hasan , Evgenii Tsymbalov

Large language models (LLMs) still grapple with complex tasks like mathematical reasoning. Despite significant efforts invested in improving prefix prompts or reasoning process, the crucial role of problem context might have been neglected.…

Computation and Language · Computer Science 2024-03-28 Haoran Liao , Jidong Tian , Shaohua Hu , Hao He , Yaohui Jin

Large language models have shown impressive capabilities in code generation, yet they often produce functionally incorrect code. Uncertainty quantification (UQ) methods have emerged as a promising approach for detecting hallucinations in…

Computation and Language · Computer Science 2026-05-28 Dylan Bouchard , Mohit Singh Chauhan , Zeya Ahmad , Ho-Kyeong Ra

Language model (LM)-based speech enhancement (SE) can generate natural-sounding speech, but under severe noise it often suffers from unreliable conditioning, leading to perceptually plausible yet linguistically incorrect outputs. To address…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-12 Zheng Wang , Xiaobin Rong , Hang Su , Tianyi Tan , Junnan Wu , Lichun Fan , Zhenbo Luo , Jian Luan , Jing Lu