English
Related papers

Related papers: HalluLens: LLM Hallucination Benchmark

200 papers

Despite their impressive generative capabilities, LLMs are hindered by fact-conflicting hallucinations in real-world applications. The accurate identification of hallucinations in texts generated by LLMs, especially in complex inferential…

Computation and Language · Computer Science 2024-05-28 Xiang Chen , Duanzheng Song , Honghao Gui , Chenxi Wang , Ningyu Zhang , Yong Jiang , Fei Huang , Chengfei Lv , Dan Zhang , Huajun Chen

The rapid advancement of Large Language Models (LLMs) has brought a pressing challenge: how to reliably assess hallucinations to guarantee model trustworthiness. Although Automatic Hallucination Evaluation (AHE) has become an indispensable…

Computation and Language · Computer Science 2025-10-22 Siya Qi , Lin Gui , Yulan He , Zheng Yuan

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

Computation and Language · Computer Science 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs. To measure the level of hallucination of LLMs, previous works…

Artificial Intelligence · Computer Science 2023-09-12 Li Du , Yequan Wang , Xingrun Xing , Yiqun Ya , Xiang Li , Xin Jiang , Xuezhi Fang

Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty. Such "hallucinations" persist even in state-of-the-art systems…

Computation and Language · Computer Science 2025-09-08 Adam Tauman Kalai , Ofir Nachum , Santosh S. Vempala , Edwin Zhang

The rapid development of Multi-modality Large Language Models (MLLMs) has significantly influenced various aspects of industry and daily life, showcasing impressive capabilities in visual perception and understanding. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yinan Sun , Zicheng Zhang , Haoning Wu , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

Computation and Language · Computer Science 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

Recent advancements in Multimodal Large Language Models (MLLMs) have extended their capabilities to video understanding. Yet, these models are often plagued by "hallucinations", where irrelevant or nonsensical content is generated,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yuxuan Wang , Yueqian Wang , Dongyan Zhao , Cihang Xie , Zilong Zheng

The widespread adoption and transformative effects of large language models (LLMs) have sparked concerns regarding their capacity to produce inaccurate and fictitious content, referred to as `hallucinations'. Given the potential risks…

Human-Computer Interaction · Computer Science 2024-08-13 Mahjabin Nahar , Haeseung Seo , Eun-Ju Lee , Aiping Xiong , Dongwon Lee

Recent advances in large language models (LLMs), such as ChatGPT, have led to highly sophisticated conversation agents. However, these models suffer from "hallucinations," where the model generates false or fabricated information.…

Computation and Language · Computer Science 2023-06-12 Philip Feldman , James R. Foulds , Shimei Pan

Hallucinations pose a significant challenge to the reliability of large vision-language models, making their detection essential for ensuring accuracy in critical applications. Current detection methods often rely on computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Eunkyu Park , Minyeong Kim , Gunhee Kim

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in vision-language understanding tasks. While these models often produce linguistically coherent output, they often suffer from hallucinations, generating…

Computation and Language · Computer Science 2025-12-09 Sujoy Nath , Arkaprabha Basu , Sharanya Dasgupta , Swagatam Das

Recent advancements in large language models (LLMs) have enhanced natural-language reasoning. However, their limited parametric memory and susceptibility to hallucination present persistent challenges for tasks requiring accurate,…

Computation and Language · Computer Science 2025-06-02 Yu-Hsuan Lin , Qian-Hui Chen , Yi-Jie Cheng , Jia-Ren Zhang , Yi-Hung Liu , Liang-Yu Hsia , Yun-Nung Chen

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

Hallucination remains a central failure mode of large language models, but existing benchmarks operationalize it inconsistently across summarization, question answering, retrieval-augmented generation, and agentic interaction. This…

Computation and Language · Computer Science 2026-05-20 Emmy Liu , Varun Gangal , Michael Yu , Zhuofu Tao , Karan Singh , Sachin Kumar , Steven Y. Feng

Medical Large Language Models (MLLMs) play a crucial role in ophthalmic diagnosis, holding significant potential to address vision-threatening diseases. However, their accuracy is constrained by hallucinations stemming from limited…

Computation and Language · Computer Science 2025-10-02 Xiaoyu Pan , Yang Bai , Ke Zou , Yang Zhou , Jun Zhou , Huazhu Fu , Yih-Chung Tham , Yong Liu

Multi-modal Large Language Models (MLLMs) tuned on machine-generated instruction-following data have demonstrated remarkable performance in various multi-modal understanding and generation tasks. However, the hallucinations inherent in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Qifan Yu , Juncheng Li , Longhui Wei , Liang Pang , Wentao Ye , Bosheng Qin , Siliang Tang , Qi Tian , Yueting Zhuang

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Large Language Models (LLMs) are known to produce hallucinations - factually incorrect or fabricated information - which poses significant challenges for many Natural Language Processing (NLP) applications, such as dialogue systems. As a…

Computation and Language · Computer Science 2025-08-11 Xiangyan Chen , Yufeng Li , Yujian Gan , Arkaitz Zubiaga , Matthew Purver