English
Related papers

Related papers: HALP: Detecting Hallucinations in Vision-Language …

200 papers

Object hallucination in Large Vision-Language Models (LVLMs) significantly impedes their real-world applicability. As the primary component for accurately interpreting visual information, the choice of visual encoder is pivotal. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Weihang Wang , Xinhao Li , Ziyue Wang , Yan Pang , Jielei Zhang , Peiyi Li , Qiang Zhang , Longwen Gao

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Wenyi Xiao , Xinchi Xu , Leilei Gan

Instruction tuned Large Vision Language Models (LVLMs) have significantly advanced in generalizing across a diverse set of multi-modal tasks, especially for Visual Question Answering (VQA). However, generating detailed responses that are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Anisha Gunjal , Jihan Yin , Erhan Bas

Visual attention serves as the primary mechanism through which MLLMs interpret visual information; however, its limited localization capability often leads to hallucinations. We observe that although MLLMs can accurately extract visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng , Zhixing Tan

As vision-language models (VLMs) are increasingly deployed in clinical decision support, more than accuracy is required: knowing when to trust their predictions is equally critical. Yet, a comprehensive and systematic investigation into the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Ji Young Byun , Young-Jin Park , Jean-Philippe Corbeil , Asma Ben Abacha

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß

Vision-Language Models (VLMs) frequently "hallucinate" - generate plausible yet factually incorrect statements - posing a critical barrier to their trustworthy deployment. In this work, we propose a new paradigm for diagnosing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lexiang Xiong , Qi Li , Jingwen Ye , Xinchao Wang

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of…

Machine Learning · Computer Science 2023-10-11 Junyang Wang , Yiyang Zhou , Guohai Xu , Pengcheng Shi , Chenlin Zhao , Haiyang Xu , Qinghao Ye , Ming Yan , Ji Zhang , Jihua Zhu , Jitao Sang , Haoyu Tang

Contemporary Language Models (LMs), while impressively fluent, often generate content that is factually incorrect or unfaithful to the input context - a critical issue commonly referred to as 'hallucination'. This tendency of LMs to…

Computation and Language · Computer Science 2025-06-24 Anwoy Chatterjee , Yash Goel , Tanmoy Chakraborty

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

Computation and Language · Computer Science 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 April Fu

Object hallucination is a critical issue in Large Vision-Language Models (LVLMs), where outputs include objects that do not appear in the input image. A natural question arises from this phenomenon: Which component of the LVLM pipeline…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Lingfeng Ren , Weihao Yu , Runpeng Yu , Xinchao Wang

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

The use of Vision-Language Models (VLMs) in automated driving applications is becoming increasingly common, with the aim of leveraging their reasoning and generalisation capabilities to handle long tail scenarios. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Nikos Theodoridis , Reenu Mohandas , Ganesh Sistu , Anthony Scanlan , Ciarán Eising , Tim Brophy

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein

Recent advances in large video-language models have displayed promising outcomes in video comprehension. Current approaches straightforwardly convert video into language tokens and employ large language models for multi-modal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Fan Ma , Xiaojie Jin , Heng Wang , Yuchen Xian , Jiashi Feng , Yi Yang

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

Computation and Language · Computer Science 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Generative Vision-Language Models (VLMs) are prone to generate plausible-sounding textual answers that, however, are not always grounded in the input image. We investigate this phenomenon, usually referred to as "hallucination" and show…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Alessandro Favero , Luca Zancato , Matthew Trager , Siddharth Choudhary , Pramuditha Perera , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto

Hallucination has been a long-standing and inevitable problem that hinders the application of Large Vision-Language Models (LVLMs) in domains that require high reliability. Various methods focus on improvement depending on data annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Chao Wang , Jianming Yang , Yang Zhou