English
Related papers

Related papers: Revealing Perception and Generation Dynamics in LV…

200 papers

Large Vision-Language Models have shown strong multimodal reasoning capabilities, yet they remain susceptible to object hallucinations when language priors dominate insufficient or misaligned visual evidence. Training-free contrastive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Xiaoyi Huang , Kejia Zhang , Zhiming Luo

Large Vision-Language Models (LVLMs) can reason from image-text inputs and perform well in various multimodal tasks. Despite this success, they are affected by language priors and often produce hallucinations. Hallucinations denote…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Xinrong Chen , Xu Chu , Yingmin Qiu , Hengyuan Zhang , Jing Xiong , Shiyu Tang , Shuai Liu , Shaokang Yang , Cheng Yang , Hayden Kwok-Hay So , Ngai Wong

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 April Fu

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

Computation and Language · Computer Science 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Large Vision-Language Models (LVLMs) are susceptible to object hallucinations, an issue in which their generated text contains non-existent objects, greatly limiting their reliability and practicality. Current approaches often rely on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ailin Deng , Zhirui Chen , Bryan Hooi

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

Computation and Language · Computer Science 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Large Vision-Language Models (LVLMs) are increasingly adept at generating contextually detailed and coherent responses from visual inputs. However, their application in multimodal decision-making and open-ended generation is hindered by a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Xintong Wang , Jingheng Pan , Liang Ding , Chris Biemann

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

Machine Learning · Computer Science 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Recently developed large language models have achieved remarkable success in generating fluent and coherent text. However, these models often tend to 'hallucinate' which critically hampers their reliability. In this work, we address this…

Computation and Language · Computer Science 2023-08-15 Neeraj Varshney , Wenlin Yao , Hongming Zhang , Jianshu Chen , Dong Yu

Large Language Models (LLMs) often hallucinate, generating content inconsistent with the input. Retrieval-Augmented Generation (RAG) and Reinforcement Learning with Human Feedback (RLHF) can mitigate hallucinations but require…

Computation and Language · Computer Science 2026-02-02 Yifan Zhu , Huiqiang Rong , Haoran Luo

Recent decoding methods improve the factuality of large language models (LLMs) by refining how the next token is selected during generation. These methods typically operate at the token level, leveraging internal representations to suppress…

Computation and Language · Computer Science 2025-09-16 Hongxiang Zhang , Hao Chen , Muhao Chen , Tianyi Zhang

Large vision-language models (LVLMs) are now central to healthcare applications such as medical visual question answering and imaging report generation. Yet, these models remain vulnerable to hallucination outputs that appear plausible but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zahra Mahdavi , Zahra Khodakaramimaghsoud , Hooman Khaloo , Sina Bakhshandeh Taleshani , Erfan Hashemi , Javad Mirzapour Kaleybar , Omid Nejati Manzari

Hallucinations in large vision-language models (LVLMs) are a significant challenge, i.e., generating objects that are not presented in the visual input, which impairs their reliability. Recent studies often attribute hallucinations to a…

Computation and Language · Computer Science 2025-08-13 Yuying Shang , Xinyi Zeng , Yutao Zhu , Xiao Yang , Zhengwei Fang , Jingyuan Zhang , Jiawei Chen , Zinan Liu , Yu Tian

Large Vision-Language Models (LVLMs) have made remarkable developments along with the recent surge of large language models. Despite their advancements, LVLMs have a tendency to generate plausible yet inaccurate or inconsistent information…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Dexter Neo , Tsuhan Chen

Large Vision-Language Models (LVLMs) demonstrate impressive capabilities in generating detailed and coherent responses from visual inputs. However, they are prone to generate hallucinations due to an over-reliance on language priors. To…

Artificial Intelligence · Computer Science 2025-02-20 Kyungmin Min , Minbeom Kim , Kang-il Lee , Dongryeol Lee , Kyomin Jung

Despite significant advancements in Vision-Language Models (VLMs), the performance of existing VLMs remains hindered by object hallucination, a critical challenge to achieving accurate visual understanding. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Woohyeon Park , Woojin Kim , Jaeik Kim , Jaeyoung Do

Large vision-language models (LVLMs) have shown remarkable capabilities in visual-language understanding for downstream multi-modal tasks. Despite their success, LVLMs still suffer from generating hallucinations in complex generation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiaming Li , Jiacheng Zhang , Zequn Jie , Lin Ma , Guanbin Li

Large Vision-Language Models (LVLMs) have demonstrated remarkable advancements in numerous areas such as multimedia. However, hallucination issues significantly limit their credibility and application potential. Existing mitigation methods…

Machine Learning · Computer Science 2025-08-20 Wenhao Li , Xiu Su , Jingyi Wu , Feng Yang , Yang Liu , Yi Chen , Shan You , Chang Xu

Large Vision Language Models (LVLMs) demonstrate strong capabilities in visual understanding and description, yet often suffer from hallucinations, attributing incorrect or misleading features to images. We observe that LVLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Sangmin Woo , Donguk Kim , Jaehyuk Jang , Yubin Choi , Changick Kim