English
Related papers

Related papers: V-ITI: Mitigating Hallucinations in Multimodal Lar…

200 papers

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

Computation and Language · Computer Science 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Existing Large Vision-Language Models (LVLMs) primarily align image features of vision encoder with Large Language Models (LLMs) to leverage their superior text generation capabilities. However, the scale disparity between vision encoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Shi Liu , Kecheng Zheng , Wei Chen

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal tasks, but remain susceptible to hallucinations, where generated text deviates from the underlying visual content. Existing hallucination detection methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Feiran Zhang , Yixin Wu , Zhenghua Wang , Xiaohua Wang , Changze Lv , Xuanjing Huang , Xiaoqing Zheng

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

While medical Multimodal Large Language Models (MLLMs) have shown promise in assisting diagnosis, they still frequently generate hallucinated responses that appear linguistically plausible but lack visual evidence. Such hallucinations pose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiayi Chen , Benteng Ma , Zehui Liao , Winston Chong , Yasmeen George , Jianfei Cai

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

Leveraging large-scale Text-to-Image (TTI) models have become a common technique for generating exemplar or training dataset in the fields of image synthesis, video editing, 3D reconstruction. However, semantic structural visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bumsoo Kim , Wonseop Shin , Kyuchul Lee , Yonghoon Jung , Sanghyun Seo

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Despite Video Large Language Models having rapidly advanced in recent years, perceptual hallucinations pose a substantial safety risk, which severely restricts their real-world applicability. While several methods for hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yiming Sun , Mi Zhang , Feifei Li , Geng Hong , Min Yang

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Multimodal Large Language Models (MLLMs) have demonstrated strong performance in visual understanding tasks, yet they often suffer from object hallucinations--generating descriptions of objects that are inconsistent with or entirely absent…

Artificial Intelligence · Computer Science 2025-05-27 Xinmiao Hu , Chun Wang , Ruihe An , ChenYu Shao , Xiaojun Ye , Sheng Zhou , Liangcheng Li

Although Large Vision-Language Models (LVLMs) have demonstrated powerful capabilities in interpreting visual information, they frequently produce content that deviates from visual information, leading to object hallucination. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding.However, hallucination, where the model generates plausible yet incorrect outputs, persists as a significant and under-addressed challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jianfeng Cai , Wengang Zhou , Zongmeng Zhang , Jiale Hong , Nianji Zhan , Houqiang Li

Instruction tuned Large Vision Language Models (LVLMs) have significantly advanced in generalizing across a diverse set of multi-modal tasks, especially for Visual Question Answering (VQA). However, generating detailed responses that are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Anisha Gunjal , Jihan Yin , Erhan Bas

Despite the significant success of Large Vision-Language models(LVLMs), these models still suffer hallucinations when describing images, generating answers that include non-existent objects. It is reported that these models tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Li , Dehong Gao , Yeyuan Wang , Linbo Jin , Shanqing Yu , Xiaoyan Cai , Libin Yang

Visual attention serves as the primary mechanism through which MLLMs interpret visual information; however, its limited localization capability often leads to hallucinations. We observe that although MLLMs can accurately extract visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng , Zhixing Tan