English
Related papers

Related papers: Predictive Coding and Information Bottleneck for H…

200 papers

Large vision-language models (LVLMs) achieve strong performance on visual reasoning tasks but remain highly susceptible to hallucination. Existing detection methods predominantly rely on coarse, whole-image measures of how an object token…

Large language model hallucination represents a critical challenge where outputs deviate from factual accuracy due to distributional biases in training data. While recent investigations establish that specific hidden layers exhibit…

Computation and Language · Computer Science 2025-09-29 Wenkai Wang , Vincent Lee , Yizhen Zheng

The reliability of Large Language Models (LLMs) in high-stakes domains such as healthcare, law, and scientific discovery is often compromised by hallucinations. These failures typically stem from two sources: data-driven hallucinations and…

Machine Learning · Computer Science 2026-03-03 Xinyue Zeng , Junhong Lin , Yujun Yan , Feng Guo , Liang Shi , Jun Wu , Dawei Zhou

Large Language Models (LLMs) are prone to factual hallucinations, risking their reliability in real-world applications. Existing hallucination detectors mainly extract micro-level intrinsic patterns for uncertainty quantification or elicit…

Computation and Language · Computer Science 2026-05-06 Hao Mi , Qiang Sheng , Shaofei Wang , Beizhe Hu , Yifan Sun , Zhengjia Wang , Hengqi Zeng , Yang Li , Danding Wang , Juan Cao

The factual reliability of Large Language Models (LLMs) remains a critical barrier to their adoption in high-stakes domains due to their propensity to hallucinate. Current detection methods often rely on surface-level signals from the…

Computation and Language · Computer Science 2026-01-21 Shreyas N. Samaga , Gilberto Gonzalez Arroyo , Tamal K. Dey

Large Language Models (LLMs) are optimized to produce distributionally plausible continuations rather than to explicitly verify whether generated propositions are entailed by source documents. This inductive bias enables generalization, but…

Computation and Language · Computer Science 2026-05-25 Paul Landes , Pranav Herur , Adam Cross , Jimeng Sun

Multimodal Large Language Models (MLLMs) have shown impressive perception and reasoning capabilities, yet they often suffer from hallucinations -- generating outputs that are linguistically coherent but inconsistent with the context of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Bingkui Tong , Jiaer Xia , Kaiyang Zhou

Hallucinations are a persistent problem with Large Language Models (LLMs). As these models become increasingly used in high-stakes domains, such as healthcare and finance, the need for effective hallucination detection is crucial. To this…

Computation and Language · Computer Science 2026-01-29 Dylan Bouchard , Mohit Singh Chauhan

The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating…

Computation and Language · Computer Science 2024-11-20 Lei Huang , Weijiang Yu , Weitao Ma , Weihong Zhong , Zhangyin Feng , Haotian Wang , Qianglong Chen , Weihua Peng , Xiaocheng Feng , Bing Qin , Ting Liu

Object hallucination in Large Vision-Language Models (LVLMs) significantly impedes their real-world applicability. As the primary component for accurately interpreting visual information, the choice of visual encoder is pivotal. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Weihang Wang , Xinhao Li , Ziyue Wang , Yan Pang , Jielei Zhang , Peiyi Li , Qiang Zhang , Longwen Gao

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

Computation and Language · Computer Science 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

Large language model (LLM) systems suffer from the models' unstable ability to generate valid and factual content, resulting in hallucination generation. Current hallucination detection methods heavily rely on out-of-model information…

Computation and Language · Computer Science 2025-02-20 Peiran Wang , Yang Liu , Yunfei Lu , Jue Hong , Ye Wu

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a…

Computation and Language · Computer Science 2025-09-16 Yue Ding , Xiaofang Zhu , Tianze Xia , Junfei Wu , Xinlong Chen , Qiang Liu , Liang Wang

Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination Assessment via Log-probs as Time series), a lightweight hallucination detector that leverages…

Computation and Language · Computer Science 2026-02-04 Ahmad Shapiro , Karan Taneja , Ashok Goel

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

Computation and Language · Computer Science 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Multimodal Large Language Models (MLLMs) have unlocked powerful cross-modal capabilities, but still significantly suffer from hallucinations. As such, accurate detection of hallucinations in MLLMs is imperative for ensuring their…

Computation and Language · Computer Science 2025-11-18 Pinxue Guo , Chongruo Wu , Xinyu Zhou , Lingyi Hong , Zhaoyu Chen , Jinglun Li , Kaixun Jiang , Sen-ching Samson Cheung , Wei Zhang , Wenqiang Zhang

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

Computation and Language · Computer Science 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Large Language Models (LLMs) are powerful tools for text generation, translation, and summarization, but they often suffer from hallucinations-instances where they fail to maintain the fidelity and coherence of contextual information during…

Computation and Language · Computer Science 2024-10-29 Jiemin Wu , Songning Lai , Ruiqiang Xiao , Tianlang Xue , Jiayu Yang , Yutao Yue

Large language models (LLMs) trained on datasets of publicly available source code have established a new state of the art in code generation tasks. However, these models are mostly unaware of the code that exists within a specific project,…

Software Engineering · Computer Science 2024-06-21 Aryaz Eghbali , Michael Pradel

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal