English
Related papers

Related papers: Evaluating Object Hallucination in Large Vision-La…

200 papers

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

Large vision-language models (LVLMs) have recently dramatically pushed the state of the art in image captioning and many image understanding tasks (e.g., visual question answering). LVLMs, however, often \textit{hallucinate} and produce…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Gregor Geigle , Radu Timofte , Goran Glavaš

Large Vision-Language Models (LVLMs) have made remarkable developments along with the recent surge of large language models. Despite their advancements, LVLMs have a tendency to generate plausible yet inaccurate or inconsistent information…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Dexter Neo , Tsuhan Chen

Large Vision-Language Models (LVLMs) often suffer from object hallucination, making erroneous judgments about the presence of objects in images. We propose this primar- ily stems from spurious correlations arising when models strongly…

Artificial Intelligence · Computer Science 2025-11-14 Zhe Xu , Zhicai Wang , Junkang Wu , Jinda Lu , Xiang Wang

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

Artificial Intelligence · Computer Science 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Despite the outstanding performance in vision-language reasoning, Large Vision-Language Models (LVLMs) might generate hallucinated contents that do not exist in the given image. Most existing LVLM hallucination benchmarks are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Junjie Wu , Tsz Ting Chung , Kai Chen , Dit-Yan Yeung

Large Vision Language Models (LVLMs) often suffer from object hallucination, which undermines their reliability. Surprisingly, we find that simple object-based visual prompting -- overlaying visual cues (e.g., bounding box, circle) on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Sangmin Woo , Kang Zhou , Yun Zhou , Shuai Wang , Sheng Guan , Haibo Ding , Lin Lee Cheong

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Large Vision-Language Models (LVLMs) have shown impressive performance in various tasks. However, LVLMs suffer from hallucination, which hinders their adoption in the real world. Existing studies emphasized that the strong language priors…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Zongyu Wu , Yuwei Niu , Hongcheng Gao , Minhua Lin , Zhiwei Zhang , Zhifang Zhang , Qi Shi , Yilong Wang , Sike Fu , Junjie Xu , Junjie Ao , Enyan Dai , Lei Feng , Xiang Zhang , Suhang Wang

Large language models (LLMs) have shown remarkable performance in natural language processing (NLP) tasks. To comprehend and execute diverse human instructions over image data, instruction-tuned large vision-language models (LVLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Lei Wang , Jiabang He , Shenshen Li , Ning Liu , Ee-Peng Lim

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

Artificial Intelligence · Computer Science 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das

Object hallucination is a significant challenge that hinders the application of large vision-language models (LVLMs) in practice. We hypothesize that one possible origin of hallucination is the model's tendency to prioritize text generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Meng Shen , Minghao Wu , Deepu Rajan

Object hallucination is a critical issue in Large Vision-Language Models (LVLMs), where outputs include objects that do not appear in the input image. A natural question arises from this phenomenon: Which component of the LVLM pipeline…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Lingfeng Ren , Weihao Yu , Runpeng Yu , Xinchao Wang

Object hallucination in large vision-language models presents a significant challenge to their safe deployment in real-world applications. Recent works have proposed object-level hallucination scores to estimate the likelihood of object…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Seongheon Park , Sharon Li

Large Vision-Language Models (LVLMs) are susceptible to object hallucinations, an issue in which their generated text contains non-existent objects, greatly limiting their reliability and practicality. Current approaches often rely on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ailin Deng , Zhirui Chen , Bryan Hooi

Large vision-language models (LVLMs) suffer from hallucination, resulting in misalignment between the output textual response and the input visual content. Recent research indicates that the over-reliance on the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuxi Xie , Guanzhen Li , Xiao Xu , Min-Yen Kan

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu