English
Related papers

Related papers: INTER: Mitigating Hallucination in Large Vision-La…

200 papers

Recent advancements in large vision-language models (LVLMs) have demonstrated impressive capability in visual information understanding with human language. Despite these advances, LVLMs still face challenges with multimodal hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Zongbo Han , Zechen Bai , Haiyang Mei , Qianli Xu , Changqing Zhang , Mike Zheng Shou

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 April Fu

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jiaqi Wang , Yifei Gao , Jitao Sang

Despite their remarkable progress in multimodal understanding tasks, large vision language models (LVLMs) often suffer from "hallucinations", generating texts misaligned with the visual context. Existing methods aimed at reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Sreetama Sarkar , Yue Che , Alex Gavin , Peter A. Beerel , Souvik Kundu

Hallucination has been a long-standing and inevitable problem that hinders the application of Large Vision-Language Models (LVLMs) in domains that require high reliability. Various methods focus on improvement depending on data annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Chao Wang , Jianming Yang , Yang Zhou

Large language models (LLMs) are prone to three types of hallucination: Input-Conflicting, Context-Conflicting and Fact-Conflicting hallucinations. The purpose of this study is to mitigate the different types of hallucination by exploiting…

Artificial Intelligence · Computer Science 2025-06-17 Ao Jia , Haiming Wu , Guohui Yao , Dawei Song , Songkun Ji , Yazhou Zhang

Although Large Visual Language Models (LVLMs) have demonstrated exceptional abilities in understanding multimodal data, they invariably suffer from hallucinations, leading to a disconnect between the generated text and the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinyu Lyu , Beitao Chen , Lianli Gao , Jingkuan Song , Heng Tao Shen

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

Computation and Language · Computer Science 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

Machine Learning · Computer Science 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of…

Machine Learning · Computer Science 2023-10-11 Junyang Wang , Yiyang Zhou , Guohai Xu , Pengcheng Shi , Chenlin Zhao , Haiyang Xu , Qinghao Ye , Ming Yan , Ji Zhang , Jihua Zhu , Jitao Sang , Haoyu Tang

Despite the recent breakthroughs achieved by Large Vision Language Models (LVLMs) in understanding and responding to complex visual-textual contexts, their inherent hallucination tendencies limit their practical application in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Junzhe Chen , Tianshu Zhang , Shiyu Huang , Yuwei Niu , Linfeng Zhang , Lijie Wen , Xuming Hu

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

Computation and Language · Computer Science 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du