English
Related papers

Related papers: Cost-Effective Hallucination Detection for LLMs

200 papers

Large language models (LLMs) frequently generate hallucinations-content that deviates from factual accuracy or provided context-posing challenges for diagnosis due to the complex interplay of underlying causes. This paper introduces a…

Computation and Language · Computer Science 2025-04-18 Yiyou Sun , Yu Gai , Lijie Chen , Abhilasha Ravichander , Yejin Choi , Dawn Song

Large language models (LLMs) are increasingly deployed across diverse domains, yet they are prone to generating factually incorrect outputs - commonly known as "hallucinations." Among existing mitigation strategies, uncertainty-based…

Computation and Language · Computer Science 2025-03-11 Samir Abdaljalil , Hasan Kurban , Parichit Sharma , Erchin Serpedin , Rachad Atat

MLLMs often generate outputs that are inconsistent with the visual content, a challenge known as hallucination. Previous methods focus on determining whether a generated output is hallucinated, without identifying which image region leads…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Zheng Lin , Zhenxing Niu , Zhibin Wang , Yinghui Xu

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Hallucination detection in Large Language Models (LLMs) is crucial for ensuring their reliability. This work presents our participation in the CLEF ELOQUENT HalluciGen shared task, where the goal is to develop evaluators for both generating…

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, but they remain susceptible to hallucination, particularly object hallucination where non-existent objects or incorrect attributes are…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Cong-Duy Nguyen , Xiaobao Wu , Duc Anh Vu , Shuai Zhao , Thong Nguyen , Anh Tuan Luu

Hallucination, i.e., generating factually incorrect content, remains a critical challenge for large language models (LLMs). We introduce TOHA, a TOpology-based HAllucination detector in the RAG setting, which leverages a topological…

As large language models continue to develop in the field of AI, text generation systems are susceptible to a worrisome phenomenon known as hallucination. In this study, we summarize recent compelling insights into hallucinations in LLMs.…

Computation and Language · Computer Science 2023-09-14 Hongbin Ye , Tong Liu , Aijia Zhang , Wei Hua , Weiqiang Jia

While large language models (LLMs) have demonstrated remarkable capabilities across a range of downstream tasks, a significant concern revolves around their propensity to exhibit hallucinations: LLMs occasionally generate content that…

Computation and Language · Computer Science 2025-09-16 Yue Zhang , Yafu Li , Leyang Cui , Deng Cai , Lemao Liu , Tingchen Fu , Xinting Huang , Enbo Zhao , Yu Zhang , Chen Xu , Yulong Chen , Longyue Wang , Anh Tuan Luu , Wei Bi , Freda Shi , Shuming Shi

Recent technical breakthroughs in large language models (LLMs) have enabled them to fluently generate source code. Software developers often leverage both general-purpose and code-specialized LLMs to revise existing code or even generate a…

Software Engineering · Computer Science 2025-05-14 Yunseo Lee , John Youngeun Song , Dongsun Kim , Jindae Kim , Mijung Kim , Jaechang Nam

This paper introduces KnowHalu, a novel approach for detecting hallucinations in text generated by large language models (LLMs), utilizing step-wise reasoning, multi-formulation query, multi-form knowledge for factual checking, and…

Computation and Language · Computer Science 2024-04-05 Jiawei Zhang , Chejian Xu , Yu Gai , Freddy Lecue , Dawn Song , Bo Li

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang

Contemporary Language Models (LMs), while impressively fluent, often generate content that is factually incorrect or unfaithful to the input context - a critical issue commonly referred to as 'hallucination'. This tendency of LMs to…

Computation and Language · Computer Science 2025-06-24 Anwoy Chatterjee , Yash Goel , Tanmoy Chakraborty

Large Language Models (LLMs) are increasingly used to generate summaries of software bug reports, including sections such as Steps-to-Reproduce (S2R), Actual Behavior (AB), and Expected Behavior (EB). However, these models frequently…

Software Engineering · Computer Science 2026-05-26 Hinduja Nirujan , Shreyas Patil , Abdallah Ayoub , Ahmad Abdel Latif , Gouri Ginde

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

Computation and Language · Computer Science 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

In recent studies, the extensive utilization of large language models has underscored the importance of robust evaluation methodologies for assessing text generation quality and relevance to specific tasks. This has revealed a prevalent…

Computation and Language · Computer Science 2024-03-20 Patanjali Bhamidipati , Advaith Malladi , Manish Shrivastava , Radhika Mamidi

As large language models (LLMs) evolve from conversational assistants into agents capable of handling complex tasks, they are increasingly deployed in high-risk domains. However, existing benchmarks largely rely on mixed queries and…

Computation and Language · Computer Science 2026-04-28 Yuhe Wu , Guangyu Wang , Yuran Chen , Jiatong Zhang , Yutong Zhang , Yujie Chen , Jiaming Shang , Guang Zhang , Zhuang Liu

Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. However, they are prone to generating fluent yet untruthful responses, known as "hallucinations". Hallucinations can lead to…

Computation and Language · Computer Science 2024-06-18 Minda Hu , Bowei He , Yufei Wang , Liangyou Li , Chen Ma , Irwin King

Recently, there has been increased interest in Small Language Models (SLMs), which are fast, show good performance, and have lower hardware demands than large language models (LLMs). However, SLMs hallucinate more frequently than LLMs,…

Computation and Language · Computer Science 2026-05-28 Saptarshi Sengupta , Suhang Wang