English
Related papers

Related papers: Watermarking for Factuality: Guiding Vision-Langua…

200 papers

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

Watermarking is the process of embedding information into an image that can survive under distortions, while requiring the encoded image to have little or no perceptual difference from the original image. Recently, deep learning-based…

Multimedia · Computer Science 2020-01-15 Xiyang Luo , Ruohan Zhan , Huiwen Chang , Feng Yang , Peyman Milanfar

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

While large vision-language models (LVLMs) have demonstrated impressive capabilities in interpreting multi-modal contexts, they invariably suffer from object hallucinations (OH). We introduce HALC, a novel decoding algorithm designed to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Zhaorun Chen , Zhuokai Zhao , Hongyin Luo , Huaxiu Yao , Bo Li , Jiawei Zhou

Large language models (LLMs) exhibit excellent performance in natural language processing (NLP), but remain highly sensitive to the quality of input queries, especially when these queries contain misleading or inaccurate information.…

Computation and Language · Computer Science 2025-06-02 Guocong Li , Weize Liu , Yihang Wu , Ping Wang , Shuaihan Huang , Hongxia Xu , Jian Wu

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, but they remain susceptible to hallucination, particularly object hallucination where non-existent objects or incorrect attributes are…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Cong-Duy Nguyen , Xiaobao Wu , Duc Anh Vu , Shuai Zhao , Thong Nguyen , Anh Tuan Luu

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

While Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse tasks, their practical deployment is severely hindered by hallucination issues, which become particularly acute during Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Miao Pan , Wangjie Gan , Jintao Chen , Wenqi Zhang , Bing Sun , Jianwei Yin , Xuhong Zhang

Current research on video hallucination mitigation primarily focuses on isolated error types, leaving compositional hallucinations, arising from incorrect reasoning over multiple interacting spatial and temporal factors largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenbin Xing , Quanxing Zha , Lizheng Zu , Mengran Li , Ming Li , Junchi Yan

Large Vision-Language Models (VLMs) have achieved remarkable multimodal performance yet remain prone to factual hallucinations, particularly in long-tail or specialized domains. Moreover, current models exhibit a weak capacity to refuse…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Junru Song , Yimeng Hu , Yijing Chen , Huining Li , Qian Li , Lizhen Cui , Yuntao Du

Vision-Language Models (VLMs) increasingly power high-stakes applications, from medical imaging to autonomous systems, yet they routinely hallucinate, confidently describing content not present in the input. We investigate the root causes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Harshvardhan Saini , Samyak Jha , Yiming Tang , Dianbo Liu

Although Large Language Models (LLMs) excel in reasoning and generation for language tasks, they are not specifically designed for multimodal challenges. Training Multimodal Large Language Models (MLLMs), however, is resource-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yuqi Pang , Bowen Yang , Haoqin Tu , Yun Cao , Zeyu Zhang

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

Computation and Language · Computer Science 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Large vision-language models (LVLMs) demonstrate strong visual question answering (VQA) capabilities but are shown to hallucinate. A reliable model should perceive its knowledge boundaries-knowing what it knows and what it does not. This…

Computation and Language · Computer Science 2025-08-27 Zhikai Ding , Shiyu Ni , Keping Bi

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external…

Artificial Intelligence · Computer Science 2026-01-23 Manish Bhatt

Large Vision-Language Models (LVLMs) excel in diverse cross-modal tasks. However, object hallucination, where models produce plausible but inaccurate object descriptions, remains a significant challenge. In contrast to previous work…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yiyang Huang , Liang Shi , Yitian Zhang , Yi Xu , Yun Fu

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits,…

Machine Learning · Computer Science 2024-10-14 Yapei Chang , Kalpesh Krishna , Amir Houmansadr , John Wieting , Mohit Iyyer

Though advanced in understanding visual information with human languages, Large Vision-Language Models (LVLMs) still suffer from multimodal hallucinations. A natural concern is that during multimodal interaction, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weihong Zhong , Xiaocheng Feng , Liang Zhao , Qiming Li , Lei Huang , Yuxuan Gu , Weitao Ma , Yuan Xu , Bing Qin

Large Vision-Language Models (LVLMs) have exhibited impressive capabilities across various visual tasks, yet they remain hindered by the persistent challenge of hallucinations. To address this critical issue, we propose Mixture of Decoding…

Computation and Language · Computer Science 2025-06-11 Xinlong Chen , Yuanxing Zhang , Qiang Liu , Junfei Wu , Fuzheng Zhang , Tieniu Tan