English
Related papers

Related papers: Mitigating Low-Level Visual Hallucinations Require…

200 papers

Large Language Models (LLMs) are prone to hallucinations, e.g., factually incorrect information, in their responses. These hallucinations present challenges for LLM-based applications that demand high factual accuracy. Existing…

Computation and Language · Computer Science 2025-03-13 Borui Yang , Md Afif Al Mamun , Jie M. Zhang , Gias Uddin

Large Visual Language Models (LVLMs) have demonstrated impressive capabilities across multiple tasks. However, their trustworthiness is often challenged by hallucinations, which can be attributed to the modality misalignment and the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiulong Wu , Zhengliang Shi , Shuaiqiang Wang , Jizhou Huang , Dawei Yin , Lingyong Yan , Min Cao , Min Zhang

Hallucinations in Large Vision-Language Models (LVLMs) pose significant security and reliability risks in real-world applications. Inspired by the observation that humans are more error-prone when uncertain or hesitant, we investigate how…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Zhaoxu Li , Chenqi Kong , Peijun Bao , Song Xia , Yi Tu , Yi Yu , Xinghao Jiang , Xudong Jiang

Large vision-language models have become widely adopted to advance in various domains. However, developing a trustworthy system with minimal interpretable characteristics of large-scale models presents a significant challenge. One of the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Huu-Thien Tran , Thanh-Dat Truong , Khoa Luu

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Large Vision-Language Models often generate hallucinated content that is not grounded in its visual inputs. While prior work focuses on mitigating hallucinations, we instead explore leveraging hallucination correction as a training…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Lingjun Zhao , Mingyang Xie , Paola Cascante-Bonilla , Hal Daumé , Kwonjoon Lee

As scaling up training data has significantly improved the general multimodal capabilities of Large Vision-Language Models (LVLMs), they still suffer from the hallucination issue, generating text that is inconsistent with the visual input.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yifan Li , Kun Zhou , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Multimodal Large Language Models (MLLMs) excel in vision-language tasks such as image captioning but remain prone to object hallucinations, where they describe objects that do not appear in the image. To mitigate this, we propose LISA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhihui Guo , Xin Man , Hui Xu , Jie Shao , Zhiguo Jiang , Xianchao Zhang , Heng Tao Shen

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park

Hallucinations pose a significant challenge to the reliability and alignment of Large Language Models (LLMs), limiting their widespread acceptance beyond chatbot applications. Despite ongoing efforts, hallucinations remain a prevalent…

Computation and Language · Computer Science 2024-02-27 Cem Uluoglakci , Tugba Taskaya Temizel

Hallucination, a phenomenon where multimodal large language models~(MLLMs) tend to generate textual responses that are plausible but unaligned with the image, has become one major hurdle in various MLLM-related applications. Several…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Han Qiu , Jiaxing Huang , Peng Gao , Qin Qi , Xiaoqin Zhang , Ling Shao , Shijian Lu

Despite their remarkable progress in multimodal understanding tasks, large vision language models (LVLMs) often suffer from "hallucinations", generating texts misaligned with the visual context. Existing methods aimed at reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Sreetama Sarkar , Yue Che , Alex Gavin , Peter A. Beerel , Souvik Kundu

Complex visual reasoning remains a key challenge today. Typically, the challenge is tackled using methodologies such as Chain of Thought (COT) and visual instruction tuning. However, how to organically combine these two methodologies for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Wanpeng Hu , Haodi Liu , Lin Chen , Feng Zhou , Changming Xiao , Qi Yang , Changshui Zhang

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

Large vision-language models (LVLMs) are prone to hallucinations, where certain contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. While some…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xiyang Wu , Tianrui Guan , Dianqi Li , Shuaiyi Huang , Xiaoyu Liu , Xijun Wang , Ruiqi Xian , Abhinav Shrivastava , Furong Huang , Jordan Lee Boyd-Graber , Tianyi Zhou , Dinesh Manocha

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

Computation and Language · Computer Science 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

Faithfulness hallucinations in VQA occur when vision-language models produce fluent yet visually ungrounded answers, severely undermining their reliability in safety-critical applications. Existing detection methods mainly fall into two…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chaodong Tong , Qi Zhang , Chen Li , Lei Jiang , Yanbing Liu

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß