English
Related papers

Related papers: Nullu: Mitigating Object Hallucinations in Large V…

200 papers

Large vision-language models (LVLMs) frequently suffer from Object Hallucination (OH), wherein they generate descriptions containing objects that are not actually present in the input image. This phenomenon is particularly problematic in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yanbin Huang , Yisen Li , Guiyao Tie , Xiaoye Qu , Pan Zhou , Hongfei Wang , Zhaofan Zou , Hao Sun , Xuelong Li

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Object Hallucination (OH) has been acknowledged as one of the major trustworthy challenges in Large Vision-Language Models (LVLMs). Recent advancements in Large Language Models (LLMs) indicate that internal states, such as hidden states,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jinhao Duan , Fei Kong , Hao Cheng , James Diffenderfer , Bhavya Kailkhura , Lichao Sun , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

This paper presents null-shot prompting. Null-shot prompting exploits hallucination in large language models (LLMs) by instructing LLMs to utilize information from the "Examples" section that never exists within the provided context to…

Computation and Language · Computer Science 2024-11-19 Pittawat Taveekitworachai , Febri Abdullah , Ruck Thawonmas

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

Machine Learning · Computer Science 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Large Vision-Language Models (LVLMs) have advanced considerably, intertwining visual recognition and language understanding to generate content that is not only coherent but also contextually attuned. Despite their success, LVLMs still…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Sicong Leng , Hang Zhang , Guanzheng Chen , Xin Li , Shijian Lu , Chunyan Miao , Lidong Bing

Despite their impressive performance on multi-modal tasks, large vision-language models (LVLMs) tend to suffer from hallucinations. An important type is object hallucination, where LVLMs generate objects that are inconsistent with the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Shounak Datta , Dhanasekar Sundararaman

Large Language Models (LLMs) exhibit impressive reasoning and question-answering capabilities. However, they often produce inaccurate or unreliable content known as hallucinations. This unreliability significantly limits their deployment in…

Machine Learning · Computer Science 2025-09-16 Minh Vu , Brian K. Tran , Syed A. Shah , Geigh Zollicoffer , Nhat Hoang-Xuan , Manish Bhattarai

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jiaqi Wang , Yifei Gao , Jitao Sang

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

While Vision-Language Models (VLMs) have garnered increasing attention in the AI community due to their promising practical applications, they exhibit persistent hallucination issues, generating outputs misaligned with visual inputs. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiayu Hu , Beibei Li , Jiangwei Xia , Yanjun Qin , Bing Ji , Zhongshi He

Large Vision Language Models (LVLMs) often suffer from object hallucination, which undermines their reliability. Surprisingly, we find that simple object-based visual prompting -- overlaying visual cues (e.g., bounding box, circle) on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Sangmin Woo , Kang Zhou , Yun Zhou , Shuai Wang , Sheng Guan , Haibo Ding , Lin Lee Cheong

Despite great success across various multimodal tasks, Large Vision-Language Models (LVLMs) often encounter object hallucinations with generated textual responses being inconsistent with the actual objects in images. We examine different…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenbin An , Feng Tian , Sicong Leng , Jiahao Nie , Haonan Lin , QianYing Wang , Ping Chen , Xiaoqin Zhang , Shijian Lu

Multimodal large language models (MLLMs) are increasingly adopted in remote sensing (RS) and have shown strong performance on tasks such as RS visual grounding (RSVG), RS visual question answering (RSVQA), and multimodal dialogue. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Zihui Zhou , Yong Feng , Yanying Chen , Guofan Duan , Zhenxi Song , Mingliang Zhou , Weijia Jia

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, yet they remain susceptible to hallucinations -- generating content that is factually incorrect, unfaithful to provided…

Computation and Language · Computer Science 2026-05-25 Ahmed Cherif

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

Current popular Large Vision-Language Models (LVLMs) are suffering from Hallucinations on Object Attributes (HoOA), leading to incorrect determination of fine-grained attributes in the input images. Leveraging significant advancements in 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Zhijie Tan , Yuzhi Li , Shengwei Meng , Xiang Yuan , Weiping Li , Tong Mo , Bingce Wang , Xu Chu

Large vision-language models show tremendous potential in understanding visual information through human languages. However, they are prone to suffer from object hallucination, i.e., the generated image descriptions contain objects that do…

Computation and Language · Computer Science 2025-03-03 Jiaqi Bai , Hongcheng Guo , Zhongyuan Peng , Jian Yang , Zhoujun Li , Mohan Li , Zhihong Tian

Hallucinations in Large Language Models (LLMs) pose a major barrier to their reliable use in critical decision-making. Although existing hallucination detection methods have improved accuracy, they still struggle with disentangling semantic…

Computation and Language · Computer Science 2026-04-02 Junjie Hu , Gang Tu , ShengYu Cheng , Jinxin Li , Jinting Wang , Rui Chen , Zhilong Zhou , Dongbo Shan