English
Related papers

Related papers: Internal Representations as Indicators of Hallucin…

200 papers

Despite their impressive performance across a wide range of tasks, Large Vision-Language Models (LVLMs) remain prone to hallucination. In this study, we propose a comprehensive intervention framework aligned with the transformer's causal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jiaye Qian , Ge Zheng , Yuchen Zhu , Sibei Yang

Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs). Nevertheless, LLMs frequently "hallucinate," resulting in non-factual outputs. Our carefully-designed human evaluation…

Computation and Language · Computer Science 2024-03-22 Jian Guan , Jesse Dodge , David Wadden , Minlie Huang , Hao Peng

Large language models (LLMs) have been shown to possess impressive capabilities, while also raising crucial concerns about the faithfulness of their responses. A primary issue arising in this context is the management of (un)answerable…

Computation and Language · Computer Science 2023-11-14 Aviv Slobodkin , Omer Goldman , Avi Caciularu , Ido Dagan , Shauli Ravfogel

Large language models (LLMs) are increasingly used as alternatives to traditional search engines given their capacity to generate text that resembles human language. However, this shift is concerning, as LLMs often generate hallucinations,…

Computation and Language · Computer Science 2024-10-25 Cléa Chataigner , Afaf Taïk , Golnoosh Farnadi

Large language models (LLMs) have been noted to fabricate scholarly citations, yet the scope of this behavior across providers, domains, and prompting conditions remains poorly quantified. We present one of the largest citation…

Computation and Language · Computer Science 2026-03-05 MZ Naser

Vision-Language Models (VLMs) excel at multimodal tasks, but they remain vulnerable to hallucinations that are factually incorrect or ungrounded in the input image. Recent work suggests that hallucination detection using internal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ryuhei Miyazato , Shunsuke Kitada , Kei Harada

Large Language Models (LLMs) have demonstrated advanced capabilities but often suffer from factual inaccuracies (hallucinations) and systematic biases. These issues, sometimes amplified in specific architectures like Mixture-of-Experts…

Computation and Language · Computer Science 2026-04-28 Shuai Wu , Xue Li , Yanna Feng , Yufang Li , Zhijun Wang , Ran Wang

Recently developed large language models have achieved remarkable success in generating fluent and coherent text. However, these models often tend to 'hallucinate' which critically hampers their reliability. In this work, we address this…

Computation and Language · Computer Science 2023-08-15 Neeraj Varshney , Wenlin Yao , Hongming Zhang , Jianshu Chen , Dong Yu

Recently, 3D-LLMs, which combine point-cloud encoders with large models, have been proposed to tackle complex tasks in embodied intelligence and scene understanding. In addition to showing promising results on 3D tasks, we found that they…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Ruiying Peng , Kaiyuan Li , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Hallucinations remain a significant challenge in current Generative AI models, undermining trust in AI systems and their reliability. This study investigates how orchestrating multiple specialized Artificial Intelligent Agents can help…

Computation and Language · Computer Science 2025-01-27 Diego Gosmar , Deborah A. Dahl

Large Language Models (LLMs) have shown significant potential in automating code generation tasks offering new opportunities across software engineering domains. However, their practical application remains limited due to hallucinations -…

Software Engineering · Computer Science 2025-08-18 Marc Pavel , Nenad Petrovic , Lukasz Mazur , Vahid Zolfaghari , Fengjunjie Pan , Alois Knoll

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

Artificial Intelligence · Computer Science 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

The prevalent use of large language models (LLMs) in various domains has drawn attention to the issue of "hallucination," which refers to instances where LLMs generate factually inaccurate or ungrounded information. Existing techniques for…

Computation and Language · Computer Science 2023-10-10 Junyu Luo , Cao Xiao , Fenglong Ma

Large Language Models (LLMs) demonstrate potential in complex legal tasks like argument generation, yet their reliability remains a concern. Building upon pilot work assessing LLM generation of 3-ply legal arguments using human evaluation,…

Computation and Language · Computer Science 2025-06-04 Li Zhang , Morgan Gray , Jaromir Savelka , Kevin D. Ashley

Large language models (LLMs) are prone to hallucinations, which sparked a widespread effort to detect and prevent them. Recent work attempts to mitigate hallucinations by intervening in the model's generation, typically computing…

Computation and Language · Computer Science 2024-07-12 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

Machine Learning · Computer Science 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Large language models (LLMs) showcase many desirable traits for intelligent and helpful robots. However, they are also known to hallucinate predictions. This issue is exacerbated in robotics where LLM hallucinations may result in robots…

Robotics · Computer Science 2025-06-18 James F. Mullen , Dinesh Manocha

Hallucination remains a critical challenge for deploying Large Language Models (LLMs) in finance. Accurate extraction and precise calculation from tabular data are essential for reliable financial analysis, since even minor numerical errors…

Machine Learning · Computer Science 2025-10-27 Mengao Zhang , Jiayu Fu , Tanya Warrier , Yuwen Wang , Tianhui Tan , Ke-wei Huang

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang