English
Related papers

Related papers: Why and How LLMs Hallucinate: Connecting the Dots …

200 papers

Large language models are extensively applied across a wide range of tasks, such as customer support, content creation, educational tutoring, and providing financial guidance. However, a well-known drawback is their predisposition to…

Computation and Language · Computer Science 2024-07-08 Noa Nonkes , Sergei Agaronian , Evangelos Kanoulas , Roxana Petcu

Large language models (LLMs) have been noted to fabricate scholarly citations, yet the scope of this behavior across providers, domains, and prompting conditions remains poorly quantified. We present one of the largest citation…

Computation and Language · Computer Science 2026-03-05 MZ Naser

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

Computation and Language · Computer Science 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

Large Language Models (LLMs) often exhibit \textit{hallucinations}, generating factually incorrect or semantically irrelevant content in response to prompts. Chain-of-Thought (CoT) prompting can mitigate hallucinations by encouraging…

Computation and Language · Computer Science 2025-09-17 Jiahao Cheng , Tiancheng Su , Jia Yuan , Guoxiu He , Jiawei Liu , Xinqi Tao , Jingwen Xie , Huaxia Li

Large language models (LLMs) have been shown to possess impressive capabilities, while also raising crucial concerns about the faithfulness of their responses. A primary issue arising in this context is the management of (un)answerable…

Computation and Language · Computer Science 2023-11-14 Aviv Slobodkin , Omer Goldman , Avi Caciularu , Ido Dagan , Shauli Ravfogel

Large language models (LLMs) can be prone to hallucinations - generating unreliable outputs that are unfaithful to their inputs, external facts or internally inconsistent. In this work, we address several challenges for post-hoc…

Computation and Language · Computer Science 2024-08-12 Simon Valentin , Jinmiao Fu , Gianluca Detommaso , Shaoyuan Xu , Giovanni Zappella , Bryan Wang

While the problem of hallucinations in neural machine translation has long been recognized, so far the progress on its alleviation is very little. Indeed, recently it turned out that without artificially encouraging models to hallucinate,…

Computation and Language · Computer Science 2022-12-21 David Dale , Elena Voita , Loïc Barrault , Marta R. Costa-jussà

We show that language models hallucinate not because they fail to detect uncertainty, but because of a failure to integrate it into output generation. Across architectures, uncertain inputs are reliably identified, occupying…

Artificial Intelligence · Computer Science 2026-03-17 Valeria Ruscio , Keiran Thompson

Large language models (LLMs) are increasingly used as alternatives to traditional search engines given their capacity to generate text that resembles human language. However, this shift is concerning, as LLMs often generate hallucinations,…

Computation and Language · Computer Science 2024-10-25 Cléa Chataigner , Afaf Taïk , Golnoosh Farnadi

Uncertainty estimation is a necessary component when implementing AI in high-risk settings, such as autonomous cars, medicine, or insurances. Large Language Models (LLMs) have seen a surge in popularity in recent years, but they are subject…

Machine Learning · Computer Science 2024-12-09 Gabriel Y. Arteaga , Thomas B. Schön , Nicolas Pielawski

Hallucinations in large vision-language models (LVLMs) are a significant challenge, i.e., generating objects that are not presented in the visual input, which impairs their reliability. Recent studies often attribute hallucinations to a…

Computation and Language · Computer Science 2025-08-13 Yuying Shang , Xinyi Zeng , Yutao Zhu , Xiao Yang , Zhengwei Fang , Jingyuan Zhang , Jiawei Chen , Zinan Liu , Yu Tian

While large language models (LLMs) have taken great strides towards helping humans with a plethora of tasks, hallucinations remain a major impediment towards gaining user trust. The fluency and coherence of model generations even when…

Computation and Language · Computer Science 2024-08-23 Ben Snyder , Marius Moisescu , Muhammad Bilal Zafar

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

Artificial Intelligence · Computer Science 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Hallucination poses a challenge to the deployment of large vision-language models (LVLMs) in applications. Unlike in large language models (LLMs), hallucination in LVLMs often arises from misalignments between visual inputs and textual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Sheng Liu , Haotian Ye , Lei Xing , James Zou

Large Language Models (LLMs), including GPT-3.5, LLaMA, and PaLM, seem to be knowledgeable and able to adapt to many tasks. However, we still cannot completely trust their answers, since LLMs suffer from \textbf{hallucination}\textemdash…

Computation and Language · Computer Science 2024-08-06 Jia-Yu Yao , Kun-Peng Ning , Zhen-Hui Liu , Mu-Nan Ning , Yu-Yang Liu , Li Yuan

Hallucinations in large language models (LLMs) present a growing challenge across real-world applications, from healthcare to law, where factual reliability is essential. Despite advances in alignment and instruction tuning, LLMs can still…

Computation and Language · Computer Science 2025-05-02 Makoto Sato

Large language models (LLMs) have demonstrated remarkable performance in text generation and knowledge-intensive question answering. Nevertheless, they are prone to producing hallucinated content, which severely undermines their reliability…

Computation and Language · Computer Science 2026-03-09 Shize Liang , Hongzhi Wang

Large Language Models (LLMs) can make up answers that are not real, and this is known as hallucination. This research aims to see if, how, and to what extent LLMs are aware of hallucination. More specifically, we check whether and how an…

Computation and Language · Computer Science 2024-02-16 Hanyu Duan , Yi Yang , Kar Yan Tam

Hallucinations are outputs by Large Language Models (LLMs) that are factually incorrect yet appear plausible [1]. This paper investigates how such hallucinations influence users' trust in LLMs and users' interaction with LLMs. To explore…

Artificial Intelligence · Computer Science 2025-12-11 Adrian Ryser , Florian Allwein , Tim Schlippe

Traditional language models face a challenge from hallucinations. Their very presence casts a large, dangerous shadow over the promising realm of natural language processing. It becomes crucial to understand the various kinds of…

Computation and Language · Computer Science 2025-12-03 Parth Pulkundwar , Vivek Dhanawade , Rohit Yadav , Minal Sonkar , Medha Asurlekar , Sarita Rathod