English
Related papers

Related papers: Feedback-Enhanced Hallucination-Resistant Vision-L…

200 papers

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Vision-Language Models (VLMs) have achieved strong results in video understanding, yet a key question remains: do they truly comprehend visual content or only learn shallow correlations between vision and language? Real visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zongxia Li , Xiyang Wu , Guangyao Shi , Yubin Qin , Hongyang Du , Fuxiao Liu , Tianyi Zhou , Dinesh Manocha , Jordan Lee Boyd-Graber

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Yijia Fan , Zihao Huang , Qinglin Zeng , Kaitong Cai , Jian Wang , Keze Wang

Large language models (LLMs) have revolutionized natural language processing, yet their tendency to hallucinate poses serious challenges for reliable deployment. Despite numerous hallucination detection methods, their evaluations often rely…

Computation and Language · Computer Science 2025-08-15 Denis Janiak , Jakub Binkowski , Albert Sawczyn , Bogdan Gabrys , Ravid Shwartz-Ziv , Tomasz Kajdanowicz

Detecting content that contradicts or is unsupported by a given source text is a critical challenge for the safe deployment of generative language models. We introduce HALT-RAG, a post-hoc verification system designed to identify…

Computation and Language · Computer Science 2025-09-10 Saumya Goswami , Siddharth Kurra

Contrastive learning models based on Siamese structure have demonstrated remarkable performance in self-supervised learning. Such a success of contrastive learning relies on two conditions, a sufficient number of positive pairs and adequate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jing Wu , Jennifer Hobbs , Naira Hovakimyan

Most research on hallucinations in Large Vision-Language Models (LVLMs) focuses on factual description tasks that prohibit any output absent from the image. However, little attention has been paid to hallucinations in voluntary imagination…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xingming Long , Jie Zhang , Shiguang Shan , Xilin Chen

Vision-Language Models (VLMs) have become essential backbones of modern multimodal intelligence, yet their outputs remain prone to hallucination-plausible text misaligned with visual inputs. Existing alignment approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Kejia Chen , Jiawen Zhang , Jiacong Hu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song

Benchmarks measure whether a model is correct. They do not measure whether a model is reliable. This distinction is largely academic for single-shot inference, but becomes critical for agentic AI systems, where a single rephrased prompt can…

Machine Learning · Computer Science 2026-01-13 Aaron R. Flouro , Shawn P. Chadwick

Large Language Models frequently generate fluent but factually incorrect text. We propose Adaptive Activation Cancellation (AAC), a real-time inference-time framework that treats hallucination-associated neural activations as structured…

Computation and Language · Computer Science 2026-03-12 Eric Yocam , Varghese Vaidyan , Gurcan Comert , Paris Kalathas , Yong Wang , Judith L. Mwakalonge

The advancement of Large Vision-Language Models (LVLMs) has increasingly highlighted the critical issue of their tendency to hallucinate non-existing objects in the images. To address this issue, previous works focused on using specially…

Machine Learning · Computer Science 2025-06-13 Linxi Zhao , Yihe Deng , Weitong Zhang , Quanquan Gu

Hallucination occurs when large language models exhibit behavior that deviates from the boundaries of their knowledge during response generation. To address this critical issue, previous learning-based methods attempt to finetune models but…

Computation and Language · Computer Science 2025-05-27 Xueru Wen , Jie Lou , Xinyu Lu , Ji Yuqiu , Xinyan Guan , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Debing Zhang , Le Sun

Generative Vision-Language Models (VLMs) are prone to generate plausible-sounding textual answers that, however, are not always grounded in the input image. We investigate this phenomenon, usually referred to as "hallucination" and show…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Alessandro Favero , Luca Zancato , Matthew Trager , Siddharth Choudhary , Pramuditha Perera , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto

Multi-modal Large Language Models (MLLMs) demonstrate remarkable success across various vision-language tasks. However, they suffer from visual hallucination, where the generated responses diverge from the provided image. Are MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dingchen Yang , Bowen Cao , Guang Chen , Changjun Jiang

Generation of plausible yet incorrect factual information, termed hallucination, is an unsolved issue in large language models. We study the ability of language models to deliberate on the responses they give in order to correct their…

Computation and Language · Computer Science 2023-09-26 Shehzaad Dhuliawala , Mojtaba Komeili , Jing Xu , Roberta Raileanu , Xian Li , Asli Celikyilmaz , Jason Weston

This research paper presents the development of an AI model utilizing YOLOv8 for real-time weapon detection, aimed at enhancing safety in public spaces such as schools, airports, and public transportation systems. As incidents of violence…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Ayush Thakur , Akshat Shrivastav , Rohan Sharma , Triyank Kumar , Kabir Puri

Despite their impressive capabilities, multimodal large language models (MLLMs) are prone to hallucinations, i.e., the generated content that is nonsensical or unfaithful to input sources. Unlike in LLMs, hallucinations in MLLMs often stem…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xin Zou , Yizhou Wang , Yibo Yan , Yuanhuiyi Lyu , Kening Zheng , Sirui Huang , Junkai Chen , Peijie Jiang , Jia Liu , Chang Tang , Xuming Hu

Hallucinations in Multimodal Large Language Models (MLLMs) where generated responses fail to accurately reflect the given image pose a significant challenge to their reliability. To address this, we introduce ConVis, a novel training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yeji Park , Deokyeong Lee , Junsuk Choe , Buru Chang

Hallucinations, generating responses inconsistent with the visual input, remain a critical limitation of large vision-language models (LVLMs), especially in open-ended tasks such as image captioning and visual reasoning. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Mehrdad Fazli , Bowen Wei , Ziwei Zhu