English
Related papers

Related papers: On the Audio Hallucinations in Large Audio-Video L…

200 papers

Recent advancements in Multimodal Large Language Models (MLLMs) have extended their capabilities to video understanding. Yet, these models are often plagued by "hallucinations", where irrelevant or nonsensical content is generated,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yuxuan Wang , Yueqian Wang , Dongyan Zhao , Cihang Xie , Zilong Zheng

With the advent of rich visual representations and pre-trained language models, video captioning has seen continuous improvement over time. Despite the performance improvement, video captioning models are prone to hallucination.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Nasib Ullah , Partha Pratim Mohanta

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

Computers and Society · Computer Science 2025-09-23 Richard Ackermann , Simeon Emanuilov

Large Language Models (LLMs) are increasingly used to generate summaries of software bug reports, including sections such as Steps-to-Reproduce (S2R), Actual Behavior (AB), and Expected Behavior (EB). However, these models frequently…

Software Engineering · Computer Science 2026-05-26 Hinduja Nirujan , Shreyas Patil , Abdallah Ayoub , Ahmad Abdel Latif , Gouri Ginde

Do large language models (LLMs) know the law? These models are increasingly being used to augment legal practice, education, and research, yet their revolutionary potential is threatened by the presence of hallucinations -- textual output…

Computation and Language · Computer Science 2024-08-09 Matthew Dahl , Varun Magesh , Mirac Suzgun , Daniel E. Ho

Large language models (LLMs) have demonstrated strong instruction-following capabilities in text-based tasks. However, this ability often deteriorates in multimodal models after alignment with non-text modalities such as images or audio.…

Computation and Language · Computer Science 2025-11-13 Yiming Gao , Bin Wang , Chengwei Wei , Shuo Sun , AiTi Aw

The rapid advancement of foundation models (FMs) across language, image, audio, and video domains has shown remarkable capabilities in diverse tasks. However, the proliferation of FMs brings forth a critical challenge: the potential to…

Machine Learning · Computer Science 2024-10-04 Pranab Sahoo , Prabhash Meharia , Akash Ghosh , Sriparna Saha , Vinija Jain , Aman Chadha

Multimodal large language models (MLLMs) contribute a powerful mechanism to understanding visual information building on large language models. However, MLLMs are notorious for suffering from hallucinations, especially when generating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kai Wu , Boyuan Jiang , Zhengkai Jiang , Qingdong He , Donghao Luo , Shengzhi Wang , Qingwen Liu , Chengjie Wang

Plausible, but inaccurate, tokens in model-generated text are widely believed to be pervasive and problematic for the responsible adoption of language models. Despite this concern, there is little scientific work that attempts to measure…

Computation and Language · Computer Science 2025-11-06 Justin D. Norman , Michael U. Rivera , D. Alex Hughes

Large language models (LMs) are prone to generate factual errors, which are often called hallucinations. In this paper, we introduce a comprehensive taxonomy of hallucinations and argue that hallucinations manifest in diverse forms, each…

Computation and Language · Computer Science 2024-08-14 Abhika Mishra , Akari Asai , Vidhisha Balachandran , Yizhong Wang , Graham Neubig , Yulia Tsvetkov , Hannaneh Hajishirzi

Video large language models have not yet been widely deployed, largely due to their tendency to hallucinate. Typical benchmarks for Video-LLMs rely simply on multiple-choice questions. Unfortunately, VideoLLMs hallucinate far more…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ruchit Rawal , Reza Shirkavand , Heng Huang , Gowthami Somepalli , Tom Goldstein

This paper proposes exploiting the common sense knowledge learned by large language models to perform zero-shot reasoning about crimes given textual descriptions of surveillance videos. We show that when video is (manually) converted to…

Computation and Language · Computer Science 2023-07-14 Anj Simmons , Rajesh Vasa

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Instruction tuned Large Vision Language Models (LVLMs) have significantly advanced in generalizing across a diverse set of multi-modal tasks, especially for Visual Question Answering (VQA). However, generating detailed responses that are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Anisha Gunjal , Jihan Yin , Erhan Bas

The hallucination issue is recognized as a fundamental deficiency of large language models (LLMs), especially when applied to fields such as finance, education, and law. Despite the growing concerns, there has been a lack of empirical…

Computation and Language · Computer Science 2023-11-28 Haoqiang Kang , Xiao-Yang Liu

Hallucinations in large language models (LLMs) - instances where models generate plausible but factually incorrect information - present a significant challenge for AI. We introduce "Ask a Local", a novel hallucination detection method…

Computation and Language · Computer Science 2025-06-05 Aldan Creo , Héctor Cerezo-Costas , Pedro Alonso-Doval , Maximiliano Hormazábal-Lagos

The widespread adoption of large language and vision models in real-world applications has made urgent the need to address hallucinations -- instances where models produce incorrect or nonsensical outputs. These errors can propagate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhengyi Ho , Siyuan Liang , Dacheng Tao

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

The increasing reliance on natural language generation (NLG) models, particularly large language models, has raised concerns about the reliability and accuracy of their outputs. A key challenge is hallucination, where models produce…

Computation and Language · Computer Science 2025-10-23 Fan Xu , Xinyu Hu , Zhenghan Yu , Li Lin , Xu Zhang , Yang Zhang , Wei Zhou , Jinjie Gu , Xiaojun Wan

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng