English
Related papers

Related papers: First Hallucination Tokens Are Different from Cond…

200 papers

Large Language Models (LLMs) are known to produce very high-quality tests and responses to our queries. But how much can we trust this generated text? In this paper, we study the problem of uncertainty quantification in LLMs. We propose a…

Computation and Language · Computer Science 2025-04-28 Muhammad Mubashar , Shireen Kudukkil Manchingal , Fabio Cuzzolin

Hallucinations in large vision-language models (LVLMs) are a significant challenge, i.e., generating objects that are not presented in the visual input, which impairs their reliability. Recent studies often attribute hallucinations to a…

Computation and Language · Computer Science 2025-08-13 Yuying Shang , Xinyi Zeng , Yutao Zhu , Xiao Yang , Zhengwei Fang , Jingyuan Zhang , Jiawei Chen , Zinan Liu , Yu Tian

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

Artificial Intelligence · Computer Science 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Large Vision-Language Models (LVLMs) can reason effectively over both textual and visual inputs, but they tend to hallucinate syntactically coherent yet visually ungrounded contents. In this paper, we investigate the internal dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhuowei Li , Haizhou Shi , Yunhe Gao , Di Liu , Zhenting Wang , Yuxiao Chen , Ting Liu , Long Zhao , Hao Wang , Dimitris N. Metaxas

Despite their impressive capabilities, multimodal large language models (MLLMs) are prone to hallucinations, i.e., the generated content that is nonsensical or unfaithful to input sources. Unlike in LLMs, hallucinations in MLLMs often stem…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xin Zou , Yizhou Wang , Yibo Yan , Yuanhuiyi Lyu , Kening Zheng , Sirui Huang , Junkai Chen , Peijie Jiang , Jia Liu , Chang Tang , Xuming Hu

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, although their susceptibility to hallucination poses significant challenges for their deployment in critical areas such as healthcare. To address…

Computation and Language · Computer Science 2024-05-13 Mengjia Niu , Hao Li , Jie Shi , Hamed Haddadi , Fan Mo

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

Machine Learning · Computer Science 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Do large language models (LLMs) know the law? These models are increasingly being used to augment legal practice, education, and research, yet their revolutionary potential is threatened by the presence of hallucinations -- textual output…

Computation and Language · Computer Science 2024-08-09 Matthew Dahl , Varun Magesh , Mirac Suzgun , Daniel E. Ho

Retrieval-Augmented Generation (RAG) aims to mitigate hallucinations in large language models (LLMs) by grounding responses in retrieved documents. Yet, RAG-based LLMs still hallucinate even when provided with correct and sufficient…

Computation and Language · Computer Science 2026-02-04 Samuel Yeh , Sharon Li , Tanwi Mallick

The hallucination problem in multimodal large language models (MLLMs) remains a common issue. Although image tokens occupy a majority of the input sequence of MLLMs, there is limited research to explore the relationship between image tokens…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Xiaofeng Zhang , Yihao Quan , Chaochen Gu , Chen Shen , Xiaosong Yuan , Shaotian Yan , Hao Cheng , Kaijie Wu , Jieping Ye

Advancements in Large Language Models (LLMs) and their increasing use in medical question-answering necessitate rigorous evaluation of their reliability. A critical challenge lies in hallucination, where models generate plausible yet…

Computation and Language · Computer Science 2025-02-21 Shrey Pandit , Jiawei Xu , Junyuan Hong , Zhangyang Wang , Tianlong Chen , Kaidi Xu , Ying Ding

Hallucinations in large language models (LLMs) - instances where models generate plausible but factually incorrect information - present a significant challenge for AI. We introduce "Ask a Local", a novel hallucination detection method…

Computation and Language · Computer Science 2025-06-05 Aldan Creo , Héctor Cerezo-Costas , Pedro Alonso-Doval , Maximiliano Hormazábal-Lagos

As large language models (LLMs) are increasingly deployed in high-stakes domains, detecting hallucinated content$\unicode{x2013}$text that is not grounded in supporting evidence$\unicode{x2013}$has become a critical challenge. Existing…

Computation and Language · Computer Science 2025-05-02 Deanna Emery , Michael Goitia , Freddie Vargus , Iulia Neagu

Detecting hallucinations in Large Language Model-generated text is crucial for their safe deployment. While probing classifiers show promise, they operate on isolated layer-token pairs and are LLM-specific, limiting their effectiveness and…

Machine Learning · Computer Science 2025-10-02 Guy Bar-Shalom , Fabrizio Frasca , Yaniv Galron , Yftah Ziser , Haggai Maron

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

Computation and Language · Computer Science 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

Computation and Language · Computer Science 2025-12-30 Sahil Kale , Antonio Luca Alfeo

Large-scale vision-language models have demonstrated impressive skill in handling tasks that involve both areas. Nevertheless, these models frequently experience significant issues with generating inaccurate information, which is…

Computation and Language · Computer Science 2024-05-07 Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

As large language models (LLMs) are increasingly applied in sensitive domains such as medicine and law, hallucination detection has become a critical task. Although numerous benchmarks have been proposed to advance research in this area,…

Computation and Language · Computer Science 2026-03-06 Yujie Ren , Niklas Gruhlke , Anne Lauscher

Since large language models (LLMs) achieve significant success in recent years, the hallucination issue remains a challenge, numerous benchmarks are proposed to detect the hallucination. Nevertheless, some of these benchmarks are not…

Computation and Language · Computer Science 2024-10-11 Kedi Chen , Qin Chen , Jie Zhou , Yishen He , Liang He

This research work delves into the manifestation of hallucination within Large Language Models (LLMs) and its consequential impacts on applications within the domain of mental health. The primary objective is to discern effective strategies…

Computation and Language · Computer Science 2024-10-16 Abdul Muqtadir , Hafiz Syed Muhammad Bilal , Ayesha Yousaf , Hafiz Farooq Ahmed , Jamil Hussain