English
Related papers

Related papers: HalCECE: A Framework for Explainable Hallucination…

200 papers

We introduce VIGIL (Visual Inconsistency & Generative In-context Lucidity), the first benchmark dataset and framework providing a fine-grained categorization of hallucinations in the multimodal image recontextualization task for large…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Joanna Wojciechowicz , Maria Łubniewska , Jakub Antczak , Justyna Baczyńska , Wojciech Gromski , Wojciech Kozłowski , Maciej Zięba

Multimodal Large Language Models (MLLMs) have unlocked powerful cross-modal capabilities, but still significantly suffer from hallucinations. As such, accurate detection of hallucinations in MLLMs is imperative for ensuring their…

Computation and Language · Computer Science 2025-11-18 Pinxue Guo , Chongruo Wu , Xinyu Zhou , Lingyi Hong , Zhaoyu Chen , Jinglun Li , Kaixun Jiang , Sen-ching Samson Cheung , Wei Zhang , Wenqiang Zhang

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

Computation and Language · Computer Science 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

Large Language Models (LLMs) have demonstrated exceptional performance across various natural language processing tasks. However, they occasionally generate inaccurate and counterfactual outputs, a phenomenon commonly referred to as…

Computation and Language · Computer Science 2025-06-04 Dingwei Chen , Feiteng Fang , Shiwen Ni , Feng Liang , Xiping Hu , Ahmadreza Argha , Hamid Alinejad-Rokny , Min Yang , Chengming Li

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

Multimedia · Computer Science 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li

This paper presents a way of enhancing the reliability of Large Multi-modal Models (LMMs) in addressing hallucination, where the models generate cross-modal inconsistent responses. Without additional training, we propose Counterfactual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Junho Kim , Yeon Ju Kim , Yong Man Ro

Recent advancements in Multimodal Large Language Models (MLLMs) have extended their capabilities to video understanding. Yet, these models are often plagued by "hallucinations", where irrelevant or nonsensical content is generated,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yuxuan Wang , Yueqian Wang , Dongyan Zhao , Cihang Xie , Zilong Zheng

The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yinan Sun , Xiongkuo Min , Zicheng Zhang , Yixuan Gao , Yuqin Cao , Guangtao Zhai

We investigate the internal representations of vision-language models (VLMs) to address hallucinations, a persistent challenge despite advances in model size and training. We project VLMs' internal image representations to their language…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Nick Jiang , Anish Kachinthaya , Suzie Petryk , Yossi Gandelsman

Identification of hallucination spans in black-box language model generated text is essential for applications in the real world. A recent attempt at this direction is SemEval-2025 Task 3, Mu-SHROOM-a Multilingual Shared Task on…

Computation and Language · Computer Science 2025-05-26 Saketh Reddy Vemula , Parameswari Krishnamurthy

Hallucinations in Large Language Models (LLMs) represent a critical barrier to their reliable deployment, a vulnerability heavily exacerbated in non-English and resource-constrained contexts. Existing detection approaches that rely on…

Computation and Language · Computer Science 2026-05-26 Riasad Alvi , Nurul Labib Sayeedi , Md. Faiyaz Abdullah Sayeedi

Leveraging large-scale Text-to-Image (TTI) models have become a common technique for generating exemplar or training dataset in the fields of image synthesis, video editing, 3D reconstruction. However, semantic structural visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bumsoo Kim , Wonseop Shin , Kyuchul Lee , Yonghoon Jung , Sanghyun Seo

Open-world detection poses significant challenges, as it requires the detection of any object using either object class labels or free-form texts. Existing related works often use large-scale manual annotated caption datasets for training,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Fanjie Kong , Yanbei Chen , Jiarui Cai , Davide Modolo

Faithfulness hallucinations are claims generated by a Large Language Model (LLM) not supported by contexts provided to the LLM. Lacking assessment standards, existing benchmarks focus on "factual statements" that rephrase source materials…

Computation and Language · Computer Science 2025-06-26 Xiaqiang Tang , Jian Li , Keyu Hu , Du Nan , Xiaolong Li , Xi Zhang , Weigao Sun , Sihong Xie

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

We introduce HallusionBench, a comprehensive benchmark designed for the evaluation of image-context reasoning. This benchmark presents significant challenges to advanced large visual-language models (LVLMs), such as GPT-4V(Vision), Gemini…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Tianrui Guan , Fuxiao Liu , Xiyang Wu , Ruiqi Xian , Zongxia Li , Xiaoyu Liu , Xijun Wang , Lichang Chen , Furong Huang , Yaser Yacoob , Dinesh Manocha , Tianyi Zhou

As Large Language Models become more ubiquitous across domains, it becomes important to examine their inherent limitations critically. This work argues that hallucinations in language models are not just occasional errors but an inevitable…

Machine Learning · Statistics 2024-09-10 Sourav Banerjee , Ayushi Agarwal , Saloni Singla

Vision Large Language Models (VLLMs) are widely acknowledged to be prone to hallucinations. Existing research addressing this problem has primarily been confined to image inputs, with limited exploration of video-based hallucinations.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wey Yeh Choong , Yangyang Guo , Mohan Kankanhalli

Large language models (LLMs) have transformed the landscape of language processing, yet struggle with significant challenges in terms of security, privacy, and the generation of seemingly coherent but factually inaccurate outputs, commonly…

Software Engineering · Computer Science 2024-09-04 Ningke Li , Yuekang Li , Yi Liu , Ling Shi , Kailong Wang , Haoyu Wang