English
Related papers

Related papers: Segmentation-Based Attention Entropy: Detecting an…

200 papers

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

In real-world applications, Large Language Models (LLMs) often hallucinate, even in Retrieval-Augmented Generation (RAG) settings, which poses a significant challenge to their deployment. In this paper, we introduce AggTruth, a method for…

Artificial Intelligence · Computer Science 2025-06-24 Piotr Matys , Jan Eliasz , Konrad Kiełczyński , Mikołaj Langner , Teddy Ferdinan , Jan Kocoń , Przemysław Kazienko

Large Vision-Language Models (LVLMs) have made remarkable developments along with the recent surge of large language models. Despite their advancements, LVLMs have a tendency to generate plausible yet inaccurate or inconsistent information…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Dexter Neo , Tsuhan Chen

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Recent studies have examined attention dynamics in large vision-language models (LVLMs) to detect hallucinations. However, existing approaches remain limited in reliably distinguishing hallucinated from factually grounded outputs, as they…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xiaofeng Zhang , Yuanchao Zhu , Chaochen Gu , Xiaosong Yuan , Qiyan Zhao , Jiawei Cao , Feilong Tang , Sinan Fan , Yaomin Shen , Chen Shen , Hao Tang

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

Computation and Language · Computer Science 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Multimodal LLMs are powerful but prone to object hallucinations, which describe non-existent entities and harm reliability. While recent unlearning methods attempt to mitigate this, we identify a critical flaw: structural fragility. We…

Machine Learning · Computer Science 2026-05-19 Xianya Fang , Feiyang Ren , Xiang Chen , Yu Tian , Zhen Bi , Haiyang Yu , Sheng-Jun Huang

The projector plays a crucial role in multi-modal language models (MLLMs). The number of visual tokens it outputs affects the efficiency of the MLLM, while the quality of the visual tokens influences the visual understanding capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Shun Qian , Bingquan Liu , Chengjie Sun , Zhen Xu , Baoxun Wang

As large language models (LLMs) become increasingly prevalent, concerns about their reliability, particularly due to hallucinations - factually inaccurate or irrelevant outputs - have grown. Our research investigates the relationship…

Artificial Intelligence · Computer Science 2025-10-08 Shahrad Mohammadzadeh , Juan David Guerra , Marco Bonizzato , Reihaneh Rabbany , Golnoosh Farnadi

By leveraging both texts and images, large vision language models (LVLMs) have shown significant progress in various multi-modal tasks. Nevertheless, these models often suffer from hallucinations, e.g., they exhibit inconsistencies between…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nhi Pham , Michael Schott

While vision-language models (VLMs) have made significant progress in multimodal perception (e.g., open-vocabulary object detection) with simple language queries, state-of-the-art VLMs still show limited ability to perceive complex queries…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sojung An , Kwanyong Park , Yong Jae Lee , Donghyun Kim

Large Vision-Language Models (LVLMs) frequently suffer from severe hallucination issues. Existing mitigation strategies predominantly rely on isolated, single-step states to enhance visual focus or suppress strong linguistic priors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Bei Yan , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen

Identification of hallucination spans in black-box language model generated text is essential for applications in the real world. A recent attempt at this direction is SemEval-2025 Task 3, Mu-SHROOM-a Multilingual Shared Task on…

Computation and Language · Computer Science 2025-05-26 Saketh Reddy Vemula , Parameswari Krishnamurthy

Hallucinations in video-capable vision-language models (Video-VLMs) remain frequent and high-confidence, while existing uncertainty metrics often fail to align with correctness. We introduce VideoHEDGE, a modular framework for hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Sushant Gautam , Cise Midoglu , Vajira Thambawita , Michael A. Riegler , Pål Halvorsen

Mitigating object hallucination in large vision-language models (LVLMs) is critical to their safe deployment. Existing methods either are restricted to specific decoding methods, or demand sophisticated modifications to visual inputs, or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Xixi Liu , Ailin Deng , Christopher Zach

Hallucinations, generating responses inconsistent with the visual input, remain a critical limitation of large vision-language models (LVLMs), especially in open-ended tasks such as image captioning and visual reasoning. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Mehrdad Fazli , Bowen Wei , Ziwei Zhu

Large Vision-Language Models (LVLMs) have exhibited impressive capabilities across various visual tasks, yet they remain hindered by the persistent challenge of hallucinations. To address this critical issue, we propose Mixture of Decoding…

Computation and Language · Computer Science 2025-06-11 Xinlong Chen , Yuanxing Zhang , Qiang Liu , Junfei Wu , Fuzheng Zhang , Tieniu Tan

Large Language Models (LLMs) are revolutionizing software engineering (SE), with special emphasis on code generation and analysis. However, their applications to broader SE practices including conceptualization, design, and other non-code…

Software Engineering · Computer Science 2025-06-16 Fabian C. Peña