中文
相关论文

相关论文: Learning Uncertainty from Sequential Internal Disp…

200 篇论文

Large Language Models (LLMs) are being increasingly deployed in real-world applications, but they remain susceptible to hallucinations, which produce fluent yet incorrect responses and lead to erroneous decision-making. Uncertainty…

机器学习 · 计算机科学 2025-12-02 Huan Ma , Jiadong Pan , Jing Liu , Yan Chen , Joey Tianyi Zhou , Guangyu Wang , Qinghua Hu , Hua Wu , Changqing Zhang , Haifeng Wang

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Recent work has shown that the hidden states of large language models contain signals useful for uncertainty estimation and hallucination detection, motivating a growing interest in efficient probe-based approaches. Yet it remains unclear…

计算与语言 · 计算机科学 2026-04-14 Joe Stacey , Hadas Orgad , Kentaro Inui , Benjamin Heinzerling , Nafise Sadat Moosavi

While Diffusion Large Language Models (dLLMs) have emerged as a promising non-autoregressive paradigm comparable to autoregressive (AR) models, their faithfulness, specifically regarding hallucination, remains largely underexplored. To…

计算与语言 · 计算机科学 2026-04-14 Zhengnan Guo , Fei Tan

The hallucination problem of Large Language Models (LLMs) significantly limits their reliability and trustworthiness. Humans have a self-awareness process that allows us to recognize what we don't know when faced with queries. Inspired by…

计算与语言 · 计算机科学 2024-10-01 Ziwei Ji , Delong Chen , Etsuko Ishii , Samuel Cahyawijaya , Yejin Bang , Bryan Wilie , Pascale Fung

Diffusion large language models (D-LLMs) have emerged as a promising alternative to auto-regressive models due to their iterative refinement capabilities. However, hallucinations remain a critical issue that hinders their reliability. To…

计算与语言 · 计算机科学 2026-03-18 Yanyu Qian , Yue Tan , Yixin Liu , Wang Yu , Shirui Pan

We explore uncertainty quantification in large language models (LLMs), with the goal to identify when uncertainty in responses given a query is large. We simultaneously consider both epistemic and aleatoric uncertainties, where the former…

机器学习 · 计算机科学 2024-07-18 Yasin Abbasi Yadkori , Ilja Kuzborskij , András György , Csaba Szepesvári

Hallucination in large language models (LLMs) can be detected by assessing the uncertainty of model outputs, typically measured using entropy. Semantic entropy (SE) enhances traditional entropy estimation by quantifying uncertainty at the…

机器学习 · 计算机科学 2025-06-03 Dang Nguyen , Ali Payani , Baharan Mirzasoleiman

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Hallucinations in Large Vision-Language Models (LVLMs) pose significant security and reliability risks in real-world applications. Inspired by the observation that humans are more error-prone when uncertain or hesitant, we investigate how…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Zhaoxu Li , Chenqi Kong , Peijun Bao , Song Xia , Yi Tu , Yi Yu , Xinghao Jiang , Xudong Jiang

Recent studies have examined attention dynamics in large vision-language models (LVLMs) to detect hallucinations. However, existing approaches remain limited in reliably distinguishing hallucinated from factually grounded outputs, as they…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Xiaofeng Zhang , Yuanchao Zhu , Chaochen Gu , Xiaosong Yuan , Qiyan Zhao , Jiawei Cao , Feilong Tang , Sinan Fan , Yaomin Shen , Chen Shen , Hao Tang

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty…

计算与语言 · 计算机科学 2025-05-30 Zhiqiu Xia , Jinxuan Xu , Yuqian Zhang , Hang Liu

Hallucination, a phenomenon where large language models (LLMs) produce output that is factually incorrect or unrelated to the input, is a major challenge for LLM applications that require accuracy and dependability. In this paper, we…

计算与语言 · 计算机科学 2025-04-01 Song Wang , Xun Wang , Jie Mei , Yujia Xie , Sean Muarray , Zhang Li , Lingfeng Wu , Si-Qing Chen , Wayne Xiong

Hallucinations in LLMs pose a significant concern to their safe deployment in real-world applications. Recent approaches have leveraged the latent space of LLMs for hallucination detection, but their embeddings, optimized for linguistic…

机器学习 · 计算机科学 2025-05-23 Seongheon Park , Xuefeng Du , Min-Hsuan Yeh , Haobo Wang , Yixuan Li

LLMs often adopt an assertive language style also when making false claims. Such ``overconfident hallucinations'' mislead users and erode trust. Achieving the ability to express in language the actual degree of uncertainty around a claim is…

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

计算与语言 · 计算机科学 2025-08-01 Esmail Gumaan

We show that language models hallucinate not because they fail to detect uncertainty, but because of a failure to integrate it into output generation. Across architectures, uncertain inputs are reliably identified, occupying…

人工智能 · 计算机科学 2026-03-17 Valeria Ruscio , Keiran Thompson

Despite the remarkable multimodal capabilities of Large Vision-Language Models (LVLMs), discrepancies often occur between visual inputs and textual outputs--a phenomenon we term visual hallucination. This critical reliability gap poses…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Tao Huang , Zhekun Liu , Rui Wang , Yang Zhang , Liping Jing

Hallucination poses a challenge to the deployment of large vision-language models (LVLMs) in applications. Unlike in large language models (LLMs), hallucination in LVLMs often arises from misalignments between visual inputs and textual…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Sheng Liu , Haotian Ye , Lei Xing , James Zou