English
Related papers

Related papers: HalluHard: A Hard Multi-Turn Hallucination Benchma…

200 papers

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Large language models (LLMs) have shown significant potential in scientific disciplines such as biomedicine, particularly in hypothesis generation, where they can analyze vast literature, identify patterns, and suggest research directions.…

Computation and Language · Computer Science 2025-06-10 Guangzhi Xiong , Eric Xie , Corey Williams , Myles Kim , Amir Hassan Shariatmadari , Sikun Guo , Stefan Bekiranov , Aidong Zhang

Hallucinations pose a significant challenge to the reliability of large language models (LLMs) in critical domains. Recent benchmarks designed to assess LLM hallucinations within conventional NLP tasks, such as knowledge-intensive question…

Computation and Language · Computer Science 2024-09-17 Zhiying Zhu , Yiming Yang , Zhiqing Sun

Hallucinations pose a significant challenge to the reliability and alignment of Large Language Models (LLMs), limiting their widespread acceptance beyond chatbot applications. Despite ongoing efforts, hallucinations remain a prevalent…

Computation and Language · Computer Science 2024-02-27 Cem Uluoglakci , Tugba Taskaya Temizel

Large language models (LLMs) hallucinate with confidence: their outputs can be fluent, authoritative, and simply wrong. In medical, legal, and scientific applications this failure causes direct harm, and detecting it from internal model…

Computation and Language · Computer Science 2026-05-19 Khizar Hussain , Murat Kantarcioglu

Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucination, generating plausible but factually incorrect or fabricated content, remains a critical challenge. This report provides a…

Computation and Language · Computer Science 2025-08-05 Manuel Cossio

Large Language Models (LLMs) have achieved unprecedented fluency but remain susceptible to "hallucinations" - the generation of factually incorrect or ungrounded content. This limitation is particularly critical in high-stakes domains where…

Computation and Language · Computer Science 2026-03-26 Md. Asraful Haque , Aasar Mehdi , Maaz Mahboob , Tamkeen Fatima

Large Language Model (LLM) hallucinations are usually treated as defects of the model or its decoding strategy. Drawing on classical linguistics, we argue that a query's form can also shape a listener's (and model's) response. We…

Computation and Language · Computer Science 2026-02-25 William Watson , Nicole Cho , Sumitra Ganesh , Manuela Veloso

Multimodal hallucination in multimodal large language models (MLLMs) restricts the correctness of MLLMs. However, multimodal hallucinations are multi-sourced and arise from diverse causes. Existing benchmarks fail to adequately distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Bowen Dong , Minheng Ni , Zitong Huang , Guanglei Yang , Wangmeng Zuo , Lei Zhang

Tool-augmented large language models (LLMs) are rapidly being integrated into real-world applications. Due to the lack of benchmarks, the community has yet to fully understand the hallucination issues within these models. To address this…

Computation and Language · Computer Science 2024-10-07 Yuxiang Zhang , Jing Chen , Junjie Wang , Yaxin Liu , Cheng Yang , Chufan Shi , Xinyu Zhu , Zihao Lin , Hanwen Wan , Yujiu Yang , Tetsuya Sakai , Tian Feng , Hayato Yamana

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

Computation and Language · Computer Science 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Large language models (LLMs) are increasingly used to answer high-stakes study-abroad questions about admissions, visas, scholarships, and eligibility. Yet it remains unclear how reliably they advise students, and how often otherwise…

Human-Computer Interaction · Computer Science 2025-11-27 Claudinei Daitx , Haitham Amar

Large language models (LLMs), such as ChatGPT, are prone to generate hallucinations, i.e., content that conflicts with the source or cannot be verified by the factual knowledge. To understand what types of content and to which extent LLMs…

Computation and Language · Computer Science 2023-10-24 Junyi Li , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Multi-modal Large Language Models (MLLMs) have emerged as a powerful paradigm for integrating visual and textual information, supporting a wide range of multi-modal tasks. However, these models often suffer from hallucination, producing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Zhiyuan Chen , Yuecong Min , Jie Zhang , Bei Yan , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

While Large Language Models have transformed how we interact with AI systems, they suffer from a critical flaw: they confidently generate false information that sounds entirely plausible. This hallucination problem has become a major…

Artificial Intelligence · Computer Science 2025-10-28 Piyushkumar Patel

Large Language Models (LLMs) exhibit impressive reasoning and question-answering capabilities. However, they often produce inaccurate or unreliable content known as hallucinations. This unreliability significantly limits their deployment in…

Machine Learning · Computer Science 2025-09-16 Minh Vu , Brian K. Tran , Syed A. Shah , Geigh Zollicoffer , Nhat Hoang-Xuan , Manish Bhattarai

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

Computation and Language · Computer Science 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

Computation and Language · Computer Science 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

Large language models (LLMs) are highly effective in various natural language processing (NLP) tasks. However, they are susceptible to producing unreliable conjectures in ambiguous contexts called hallucination. This paper presents a new…

Computation and Language · Computer Science 2024-03-07 Yuhong Sun , Zhangyue Yin , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Hui Zhao