English
Related papers

Related papers: SAKED: Mitigating Hallucination in Large Vision-La…

200 papers

Despite their impressive capacities, Large language models (LLMs) often struggle with the hallucination issue of generating inaccurate or fabricated content even when they possess correct knowledge. In this paper, we extend the exploration…

Computation and Language · Computer Science 2025-02-06 Jialiang Wu , Yi Shen , Sijia Liu , Yi Tang , Sen Song , Xiaoyi Wang , Longjun Cai

Large Vision-Language Models (LVLMs) exhibit powerful generative capabilities but frequently produce hallucinations that compromise output reliability. Fine-tuning on annotated data devoid of hallucinations offers the most direct solution,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xingyu Zhu , Junfeng Fang , Shuo Wang , Beier Zhu , Zhicai Wang , Yonghui Yang , Xiangnan He

Large Language Models (LLMs) often produce hallucinations in retrieval-augmented or long-context generation, even when relevant evidence is present. This stems from two issues: head importance is treated as input-agnostic, and raw attention…

Computation and Language · Computer Science 2025-09-09 Xin Tong , Zhi Lin , Jingya Wang , Bo Jin

Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs). To achieve this goal, we re-examine existing detection approaches based on the self-consistency of LMs and uncover two…

Computation and Language · Computer Science 2024-02-20 Jiaxin Zhang , Zhuohang Li , Kamalika Das , Bradley A. Malin , Sricharan Kumar

Large Vision-Language Models (LVLMs) have advanced considerably, intertwining visual recognition and language understanding to generate content that is not only coherent but also contextually attuned. Despite their success, LVLMs still…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Sicong Leng , Hang Zhang , Guanzheng Chen , Xin Li , Shijian Lu , Chunyan Miao , Lidong Bing

Large Vision Language Models (LVLMs) have shown remarkable capabilities in multimodal tasks like visual question answering or image captioning. However, inconsistencies between the visual information and the generated text, a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Laura Fieback , Jakob Spiegelberg , Hanno Gottschalk

Large Vision-Language Models (VLMs) often exhibit text inertia, where attention drifts from visual evidence toward linguistic priors, resulting in object hallucinations. Existing decoding strategies intervene only at the output logits and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Weijue Bu , Guan Yuan , Guixian Zhang

Large vision-language models (LVLMs) are increasingly being applied to multi-view image inputs captured from diverse viewpoints. However, despite this growing use, current LVLMs often confuse or mismatch visual information originating from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Wooje Park , Insu Lee , Soohyun Kim , Jaeyun Jang , Minyoung Noh , Kyuhong Shim , Byonghyo Shim

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen

Spatial relation hallucinations pose a persistent challenge in large vision-language models (LVLMs), leading to generate incorrect predictions about object positions and spatial configurations within an image. To address this issue, we…

Computation and Language · Computer Science 2025-03-24 Jiarui Wu , Zhuo Liu , Hangfeng He

Multimodal Large Language Models (MLLMs) frequently exhibit hallucination phenomena, but the underlying reasons remain poorly understood. In this paper, we present an empirical analysis and find that, although MLLMs incorrectly generate the…

Computation and Language · Computer Science 2025-02-25 Chenxi Wang , Xiang Chen , Ningyu Zhang , Bozhong Tian , Haoming Xu , Shumin Deng , Huajun Chen

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yinan Sun , Xiongkuo Min , Zicheng Zhang , Yixuan Gao , Yuqin Cao , Guangtao Zhai

Large Language Models (LLMs) are adept at text manipulation -- tasks such as machine translation and text summarization. However, these models can also be prone to hallucination, which can be detrimental to the faithfulness of any answers…

Computation and Language · Computer Science 2024-04-04 Priyesh Vakharia , Devavrat Joshi , Meenal Chavan , Dhananjay Sonawane , Bhrigu Garg , Parsa Mazaheri

Large Language Models suffer from hallucination, generating plausible yet factually incorrect content. Current mitigation strategies focus on post-generation correction, which is computationally expensive and fails to prevent unreliable…

Computation and Language · Computer Science 2025-10-03 Nandakishor M

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

Artificial Intelligence · Computer Science 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Hallucination remains a key obstacle to the reliable deployment of large language models (LLMs) in real-world question answering tasks. A widely adopted strategy to detect hallucination, known as self-assessment, relies on the model's own…

Artificial Intelligence · Computer Science 2025-06-04 Jinyuan Luo , Zhen Fang , Yixuan Li , Seongheon Park , Ling Chen

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß

Although Video Large Language Models perform remarkably well across tasks such as video understanding, question answering, and reasoning, they still suffer from the problem of hallucination, which refers to generating outputs that are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Yuansheng Gao , Jinman Zhao , Tong Zhang , Xingguo Xu , Han Bao , Zonghui Wang , Wenzhi Chen