English
Related papers

Related papers: Neural Diversity Regularizes Hallucinations in Lan…

200 papers

Large Language Models (LLMs) are prone to generating plausible yet incorrect responses, known as hallucinations. Effectively detecting hallucinations is therefore crucial for the safe deployment of LLMs. Recent research has linked…

Computation and Language · Computer Science 2026-03-03 Litian Liu , Reza Pourreza , Sunny Panchal , Apratim Bhattacharyya , Yubing Jian , Yao Qin , Roland Memisevic

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein

Hallucinations are outputs by Large Language Models (LLMs) that are factually incorrect yet appear plausible [1]. This paper investigates how such hallucinations influence users' trust in LLMs and users' interaction with LLMs. To explore…

Artificial Intelligence · Computer Science 2025-12-11 Adrian Ryser , Florian Allwein , Tim Schlippe

Large language models are known to hallucinate when faced with unfamiliar queries, but the underlying mechanism that govern how models hallucinate are not yet fully understood. In this work, we find that unfamiliar examples in the models'…

Machine Learning · Computer Science 2024-05-30 Katie Kang , Eric Wallace , Claire Tomlin , Aviral Kumar , Sergey Levine

While Diffusion Large Language Models (dLLMs) have emerged as a promising non-autoregressive paradigm comparable to autoregressive (AR) models, their faithfulness, specifically regarding hallucination, remains largely underexplored. To…

Computation and Language · Computer Science 2026-04-14 Zhengnan Guo , Fei Tan

Multi-modal Large Language Models (MLLMs) tuned on machine-generated instruction-following data have demonstrated remarkable performance in various multi-modal understanding and generation tasks. However, the hallucinations inherent in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Qifan Yu , Juncheng Li , Longhui Wei , Liang Pang , Wentao Ye , Bosheng Qin , Siliang Tang , Qi Tian , Yueting Zhuang

Hallucinations are a type of output error produced by deep neural networks. While this has been studied in natural language processing, they have not been researched previously in automatic speech recognition. Here, we define hallucinations…

Computation and Language · Computer Science 2024-01-04 Rita Frieske , Bertram E. Shi

Hallucination remains one of the key obstacles to the reliable deployment of large language models (LLMs), particularly in real-world applications. Among various mitigation strategies, Retrieval-Augmented Generation (RAG) and reasoning…

Computation and Language · Computer Science 2025-10-29 Yihan Li , Xiyuan Fu , Ghanshyam Verma , Paul Buitelaar , Mingming Liu

Large language models (LLMs) are increasingly used as alternatives to traditional search engines given their capacity to generate text that resembles human language. However, this shift is concerning, as LLMs often generate hallucinations,…

Computation and Language · Computer Science 2024-10-25 Cléa Chataigner , Afaf Taïk , Golnoosh Farnadi

Multimodal large language models achieve strong performance across diverse tasks but remain prone to hallucinations, where outputs are not grounded in visual inputs. This issue can be attributed to two main biases: text-visual bias, the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Shan Wang , Maying Shen , Nadine Chang , Chuong Nguyen , Hongdong Li , Jose M. Alvarez

Large language models (LLMs) exhibit remarkable capabilities in natural language processing but face catastrophic forgetting when learning new tasks, where adaptation to a new domain leads to a substantial decline in performance on previous…

Computation and Language · Computer Science 2025-03-24 Yuheng Lu , Bingshuo Qian , Caixia Yuan , Huixing Jiang , Xiaojie Wang

With the widespread adoption of large language models (LLMs), hallucinations, which are non-factual fabrications in model outputs, have become serious concerns. Reasoning capabilities have received attention as a self-verification process…

Computation and Language · Computer Science 2026-01-06 Junichiro Niimi

Hallucination is often viewed as a direct consequence of missing knowledge: a model answers incorrectly when the correct answer is absent from its generation-time distribution, and correctly when it is present. We test this assumption by…

Computation and Language · Computer Science 2026-05-22 Jewon Yeom , Jaewon Sok , Heejun Kim , Seonghyeon Park , Jeongjae Park , Taesup Kim

Hallucinations present a significant challenge for large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal…

Computation and Language · Computer Science 2025-10-07 Hanxing Ding , Liang Pang , Zihao Wei , Huawei Shen , Xueqi Cheng

Auditory large language models (ALLMs) have demonstrated strong general capabilities in audio understanding and reasoning tasks. However, their reliability is still undermined by hallucination issues. Existing hallucination evaluation…

Sound · Computer Science 2026-04-13 Qixuan Huang , Khalid Zaman , Masashi Unoki

LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce unacceptable risks where errors carry legal, financial, or safety consequences. This paper…

Artificial Intelligence · Computer Science 2026-05-27 Paul Sigloch , Christoph Benzmüller

Vision-language model (VLM) hallucination is commonly linked to imbalanced allocation of attention across input modalities: system, image and text. However, existing mitigation strategies tend towards an image-centric interpretation of…

Computation and Language · Computer Science 2026-04-27 Tsan Tsai Chan , Varsha Suresh , Anisha Saha , Michael Hahn , Vera Demberg

Recent personalization methods for diffusion models, such as Dreambooth and LoRA, allow fine-tuning pre-trained models to generate new concepts. However, applying these techniques across consecutive tasks in order to include, e.g., new…

Machine Learning · Computer Science 2025-03-14 Łukasz Staniszewski , Katarzyna Zaleska , Kamil Deja

Hallucinations, a phenomenon where a language model (LM) generates nonfactual content, pose a significant challenge to the practical deployment of LMs. While many empirical methods have been proposed to mitigate hallucinations, recent…

Computation and Language · Computer Science 2026-05-18 Atsushi Suzuki , Yulan He , Feng Tian , Zhongyuan Wang

Hallucination, where large language models (LLMs) generate confident but incorrect or irrelevant information, remains a key limitation in their application to complex, open-ended tasks. Chain-of-thought (CoT) prompting has emerged as a…

Artificial Intelligence · Computer Science 2025-05-15 Adarsh Kumar , Hwiyoon Kim , Jawahar Sai Nathani , Neil Roy