English
Related papers

Related papers: VidHalluc: Evaluating Temporal Hallucinations in M…

200 papers

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

Multimodal Large Language Models (MLLMs) emerge as a unified interface to address a multitude of tasks, ranging from NLP to computer vision. Despite showcasing state-of-the-art results in many benchmarks, a long-standing issue is the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Alberto Compagnoni , Davide Caffagni , Nicholas Moratelli , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Despite achieving outstanding performance on various cross-modal tasks, current large vision-language models (LVLMs) still suffer from hallucination issues, manifesting as inconsistencies between their generated responses and the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Rui Hu , Yahan Tu , Shuyu Wei , Dongyuan Lu , Jitao Sang

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

Large vision-language models (LVLMs) have demonstrated exceptional performance on complex multimodal tasks. However, they continue to suffer from significant hallucination issues, including object, attribute, and relational hallucinations.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yudong Zhang , Ruobing Xie , Xingwu Sun , Yiqing Huang , Jiansheng Chen , Zhanhui Kang , Di Wang , Yu Wang

Large Language Models for code generation frequently produce hallucinations in Fill-in-the-Middle (FIM) tasks -- plausible but incorrect completions such as invented API methods, invalid parameters, undefined variables, or non-existent…

Machine Learning · Computer Science 2026-05-12 Mahdi Erfanian , Nelson Daniel Troncoso , Aashna Garg , Amabel Gale , Xiaoyu Liu , Pareesa Ameneh Golnari , Shengyu Fu

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Large Vision-Language Models (LVLMs) have achieved impressive performance, yet research has pointed out a serious issue with object hallucinations within these models. However, there is no clear conclusion as to which part of the model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Yufang Liu , Tao Ji , Changzhi Sun , Yuanbin Wu , Aimin Zhou

Despite rapid advances, Large Vision-Language Models (LVLMs) still suffer from hallucinations, i.e., generating content inconsistent with input or established world knowledge, which correspond to faithfulness and factuality hallucinations,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Bei Yan , Zhiyuan Chen , Yuecong Min , Jie Zhang , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

Despite the outstanding performance in vision-language reasoning, Large Vision-Language Models (LVLMs) might generate hallucinated contents that do not exist in the given image. Most existing LVLM hallucination benchmarks are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Junjie Wu , Tsz Ting Chung , Kai Chen , Dit-Yan Yeung

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Given the higher information load processed by large vision-language models (LVLMs) compared to single-modal LLMs, detecting LVLM hallucinations requires more human and time expense, and thus rise a wider safety concerns. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ruiyang Zhang , Hu Zhang , Zhedong Zheng

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP). Although convenient for research and practical applications, open-source LLMs with fewer parameters often suffer from severe hallucinations compared to…

Computation and Language · Computer Science 2023-09-15 Mohamed Elaraby , Mengyin Lu , Jacob Dunn , Xueying Zhang , Yu Wang , Shizhu Liu , Pingchuan Tian , Yuping Wang , Yuxuan Wang

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

Computation and Language · Computer Science 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large Vision-Language Models (LVLMs) are increasingly adept at generating contextually detailed and coherent responses from visual inputs. However, their application in multimodal decision-making and open-ended generation is hindered by a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Xintong Wang , Jingheng Pan , Liang Ding , Chris Biemann

While Large Vision-Language Models (LVLMs) achieve strong performance in multimodal tasks, hallucinations continue to hinder their reliability. Among the three categories of hallucinations, which include object, attribute, and relation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yike Wu , Yiwei Wang , Yujun Cai

Multimodal Large Language Models (MLLMs) have garnered significant attention recently and demonstrate outstanding capabilities in various tasks such as OCR, VQA, captioning, $\textit{etc}$. However, hallucination remains a persistent issue.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zehao Wang , Xinpeng Liu , Yudonglin Zhang , Xiaoqian Wu , Zhou Fang , Yifan Fang , Junfu Pu , Cewu Lu , Yong-Lu Li

Recent advancements in multimodal large language models (MLLMs) have significantly improved performance in visual question answering. However, they often suffer from hallucinations. In this work, hallucinations are categorized into two main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Feilong Tang , Chengzhi Liu , Zhongxing Xu , Ming Hu , Zelin Peng , Zhiwei Yang , Jionglong Su , Minquan Lin , Yifan Peng , Xuelian Cheng , Imran Razzak , Zongyuan Ge

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

While Multimodal Large Language Models (MLLMs) have become adept at recognizing objects, they often lack the intuitive, human-like understanding of the world's underlying physical and social principles. This high-level vision-grounded…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tianxiang Jiang , Sheng Xia , Yicheng Xu , Linquan Wu , Xiangyu Zeng , Limin Wang , Yu Qiao , Yi Wang