English
Related papers

Related papers: A Low-Rank Method for Vision Language Model Halluc…

200 papers

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, yet they remain susceptible to hallucinations -- generating content that is factually incorrect, unfaithful to provided…

Computation and Language · Computer Science 2026-05-25 Ahmed Cherif

Recent studies have shown that Vision Language Large Models (VLLMs) may output content not relevant to the input images. This problem, called the hallucination phenomenon, undoubtedly degrades VLLM performance. Therefore, various…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Minyi Zhao , Jie Wang , Zhaoyang Li , Jiyuan Zhang , Zhenbang Sun , Shuigeng Zhou

Large language models (LLMs) demonstrate exceptional capabilities, yet still face the hallucination issue. Typical text generation approaches adopt an auto-regressive generation without deliberate reasoning, which often results in…

Computation and Language · Computer Science 2025-01-06 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

The advent of large language models (LLMs) has facilitated the development of natural language text generation. It also poses unprecedented challenges, with content hallucination emerging as a significant concern. Existing solutions often…

Computation and Language · Computer Science 2024-06-06 Xiaoxi Sun , Jinpeng Li , Yan Zhong , Dongyan Zhao , Rui Yan

Despite achieving rapid developments and with widespread applications, Large Vision-Language Models (LVLMs) confront a serious challenge of being prone to generating hallucinations. An over-reliance on linguistic priors has been identified…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Lanyun Zhu , Deyi Ji , Tianrun Chen , Peng Xu , Jieping Ye , Jun Liu

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Computation and Language · Computer Science 2025-01-22 Mengfei Liang , Archish Arun , Zekun Wu , Cristian Munoz , Jonathan Lutch , Emre Kazim , Adriano Koshiyama , Philip Treleaven

Segmentation Vision-Language Models (VLMs) have significantly advanced grounded visual understanding, yet they remain prone to pixel-grounding hallucinations, producing masks for incorrect objects or for objects that are entirely absent.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Xinzhuo Li , Adheesh Juvekar , Jiaxun Zhang , Xingyou Liu , Muntasir Wahed , Kiet A. Nguyen , Yifan Shen , Tianjiao Yu , Ismini Lourentzou

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mingfei Han , Haihong Hao , Jinxing Zhou , Zhihui Li , Yuhui Zheng , Xueqing Deng , Linjie Yang , Xiaojun Chang

Despite significant advancements in Vision-Language Models (VLMs), the performance of existing VLMs remains hindered by object hallucination, a critical challenge to achieving accurate visual understanding. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Woohyeon Park , Woojin Kim , Jaeik Kim , Jaeyoung Do

Multiple Choice Question Answering (MCQA) benchmarks are an established standard for measuring Vision Language Model (VLM) performance in driving tasks. However, we observe the known phenomenon that synthetically generated MCQAs are highly…

Machine Learning · Computer Science 2026-02-23 Sutej Kulgod , Sean Ye , Sanchit Tanwar , Christoffer Heckman

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

Computation and Language · Computer Science 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

The rapid growth of ego-centric dashcam footage presents a major challenge for detecting safety-critical events such as collisions and near-collisions, scenarios that are brief, rare, and difficult for generic vision models to capture.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mohammad Qazim Bhat , Yufan Huang , Niket Agarwal , Hao Wang , Michael Woods , John Kenyon , Tsung-Yi Lin , Xiaodong Yang , Ming-Yu Liu , Kevin Xie

The prevalent use of large language models (LLMs) in various domains has drawn attention to the issue of "hallucination," which refers to instances where LLMs generate factually inaccurate or ungrounded information. Existing techniques for…

Computation and Language · Computer Science 2023-10-10 Junyu Luo , Cao Xiao , Fenglong Ma

Object hallucination remains a primary obstacle to the reliable deployment of Multimodal Large Language Models (MLLMs). Current inference-time mitigation methods mainly assume hallucinations stem from visual neglect, steering models to…

Computation and Language · Computer Science 2026-05-28 Jingwen Wu , Xijun Zhang , Ge Song

Inference time scaling drives extended reasoning to enhance the performance of Vision-Language Models (VLMs), thus forming powerful Vision-Language Reasoning Models (VLRMs). However, long reasoning dilutes visual tokens, causing visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xu Chu , Xinrong Chen , Guanyu Wang , Zhijie Tan , Kui Huang , Wenyu Lv , Tong Mo , Weiping Li

Hallucinations, generating responses inconsistent with the visual input, remain a critical limitation of large vision-language models (LVLMs), especially in open-ended tasks such as image captioning and visual reasoning. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Mehrdad Fazli , Bowen Wei , Ziwei Zhu

Object hallucination is a significant challenge that hinders the application of large vision-language models (LVLMs) in practice. We hypothesize that one possible origin of hallucination is the model's tendency to prioritize text generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Meng Shen , Minghao Wu , Deepu Rajan