English
Related papers

Related papers: HalDec-Bench: Benchmarking Hallucination Detector …

200 papers

Large vision-language models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding and generation tasks. However, these models occasionally generate hallucinatory texts, resulting in descriptions that seem reasonable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jiaqi Fan , Jianhua Wu , Hongqing Chu , Quanbo Ge , Bingzhao Gao

Multimodal foundation models are prone to hallucination, generating outputs that either contradict the input or are not grounded by factual information. Given the diversity in architectures, training data and instruction tuning techniques,…

Computation and Language · Computer Science 2024-05-24 Guangzhi Sun , Potsawee Manakul , Adian Liusie , Kunat Pipatanakul , Chao Zhang , Phil Woodland , Mark Gales

A frequently observed problem with LLMs is their tendency to generate output that is nonsensical, illogical, or factually incorrect, often referred to broadly as hallucination. Building on the recently proposed HalluciGen task for…

Computation and Language · Computer Science 2025-04-30 Evangelia Gogoulou , Shorouq Zahra , Liane Guillou , Luise Dürlich , Joakim Nivre

Large Language Models (LLMs) are adept at text manipulation -- tasks such as machine translation and text summarization. However, these models can also be prone to hallucination, which can be detrimental to the faithfulness of any answers…

Computation and Language · Computer Science 2024-04-04 Priyesh Vakharia , Devavrat Joshi , Meenal Chavan , Dhananjay Sonawane , Bhrigu Garg , Parsa Mazaheri

Large Language Models (LLMs) have demonstrated remarkable performance across various tasks. However, they are prone to contextual hallucination, generating information that is either unsubstantiated or contradictory to the given context.…

Computation and Language · Computer Science 2025-04-29 Siyi Liu , Kishaloy Halder , Zheng Qi , Wei Xiao , Nikolaos Pappas , Phu Mon Htut , Neha Anna John , Yassine Benajiba , Dan Roth

Large vision-language models (LVLMs) achieve strong performance on visual reasoning tasks but remain highly susceptible to hallucination. Existing detection methods predominantly rely on coarse, whole-image measures of how an object token…

The increasing reliance on natural language generation (NLG) models, particularly large language models, has raised concerns about the reliability and accuracy of their outputs. A key challenge is hallucination, where models produce…

Computation and Language · Computer Science 2025-10-23 Fan Xu , Xinyu Hu , Zhenghan Yu , Li Lin , Xu Zhang , Yang Zhang , Wei Zhou , Jinjie Gu , Xiaojun Wan

A common approach to hallucination detection casts it as a natural language inference (NLI) task, often using LLMs to classify whether the generated text is entailed by corresponding reference texts. Since entailment classification is a…

Computation and Language · Computer Science 2025-06-06 Ron Eliav , Arie Cattan , Eran Hirsch , Shahaf Bassan , Elias Stengel-Eskin , Mohit Bansal , Ido Dagan

Large Language Models (LLMs) are increasingly used in various contexts, yet remain prone to generating non-factual content, commonly referred to as "hallucinations". The literature categorizes hallucinations into several types, including…

Computation and Language · Computer Science 2025-03-12 Samir Abdaljalil , Hasan Kurban , Erchin Serpedin

Recently, Multimodal Large Language Models (MLLMs) have made significant progress in the video comprehension field. Despite remarkable content reasoning and instruction following capabilities they demonstrated, the hallucination problem of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jiacheng Zhang , Yang Jiao , Shaoxiang Chen , Na Zhao , Zhiyu Tan , Hao Li , Xingjun Ma , Jingjing Chen

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

Machine Learning · Computer Science 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

Large Visual Language Models (LVLMs) struggle with hallucinations in visual instruction following task(s), limiting their trustworthiness and real-world applicability. We propose Pelican -- a novel framework designed to detect and mitigate…

Computation and Language · Computer Science 2024-10-30 Pritish Sahu , Karan Sikka , Ajay Divakaran

As large language models (LLMs) are increasingly applied in sensitive domains such as medicine and law, hallucination detection has become a critical task. Although numerous benchmarks have been proposed to advance research in this area,…

Computation and Language · Computer Science 2026-03-06 Yujie Ren , Niklas Gruhlke , Anne Lauscher

Hallucinations in Large Language Models (LLMs), i.e., the tendency to generate plausible but non-factual content, pose a significant challenge for their reliable deployment in high-stakes environments. However, existing hallucination…

Computation and Language · Computer Science 2026-01-29 Yitong Qiao , Licheng Pan , Yu Mi , Lei Liu , Yue Shen , Fei Sun , Zhixuan Chu

Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs). To achieve this goal, we re-examine existing detection approaches based on the self-consistency of LMs and uncover two…

Computation and Language · Computer Science 2024-02-20 Jiaxin Zhang , Zhuohang Li , Kamalika Das , Bradley A. Malin , Sricharan Kumar

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Current Visual Language Models (VLMs) show impressive image understanding but struggle with visual illusions, especially in real-world scenarios. Existing benchmarks focus on classical cognitive illusions, which have been learned by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yiming Zhang , Zicheng Zhang , Xinyi Wei , Xiaohong Liu , Guangtao Zhai , Xiongkuo Min

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guo Cheng

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Existing Large Vision-Language Models (LVLMs) primarily align image features of vision encoder with Large Language Models (LLMs) to leverage their superior text generation capabilities. However, the scale disparity between vision encoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Shi Liu , Kecheng Zheng , Wei Chen