English
Related papers

Related papers: A Probabilistic Framework for LLM Hallucination De…

200 papers

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, although their susceptibility to hallucination poses significant challenges for their deployment in critical areas such as healthcare. To address…

Computation and Language · Computer Science 2024-05-13 Mengjia Niu , Hao Li , Jie Shi , Hamed Haddadi , Fan Mo

Hallucination in large language models (LLMs) can be detected by assessing the uncertainty of model outputs, typically measured using entropy. Semantic entropy (SE) enhances traditional entropy estimation by quantifying uncertainty at the…

Machine Learning · Computer Science 2025-06-03 Dang Nguyen , Ali Payani , Baharan Mirzasoleiman

The questionable responses caused by knowledge hallucination may lead to LLMs' unstable ability in decision-making. However, it has never been investigated whether the LLMs' hallucination is possibly usable to generate negative reasoning…

Computation and Language · Computer Science 2025-03-13 Chaowei Zhang , Zongling Feng , Zewei Zhang , Jipeng Qiang , Guandong Xu , Yun Li

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

Computation and Language · Computer Science 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

Large Language Models (LLMs) have demonstrated remarkable human-level natural language generation capabilities. However, their potential to generate misinformation, often called the hallucination problem, poses a significant risk to their…

Computation and Language · Computer Science 2023-10-16 Sehyun Choi , Tianqing Fang , Zhaowei Wang , Yangqiu Song

Unsupervised hallucination detection aims to identify hallucinated content generated by large language models (LLMs) without relying on labeled data. While unsupervised methods have gained popularity by eliminating labor-intensive human…

Computation and Language · Computer Science 2025-09-15 Ponhvoan Srey , Xiaobao Wu , Anh Tuan Luu

Self-detection for Large Language Models (LLMs) seeks to evaluate the trustworthiness of the LLM's output by leveraging its own capabilities, thereby alleviating the issue of output hallucination. However, existing self-detection approaches…

Computation and Language · Computer Science 2024-09-30 Moxin Li , Wenjie Wang , Fuli Feng , Fengbin Zhu , Qifan Wang , Tat-Seng Chua

The reliability of Large Language Models (LLMs) in high-stakes domains such as healthcare, law, and scientific discovery is often compromised by hallucinations. These failures typically stem from two sources: data-driven hallucinations and…

Machine Learning · Computer Science 2026-03-03 Xinyue Zeng , Junhong Lin , Yujun Yan , Feng Guo , Liang Shi , Jun Wu , Dawei Zhou

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Hallucinations in Large Language Models (LLMs) represent a critical barrier to their reliable deployment, a vulnerability heavily exacerbated in non-English and resource-constrained contexts. Existing detection approaches that rely on…

Computation and Language · Computer Science 2026-05-26 Riasad Alvi , Nurul Labib Sayeedi , Md. Faiyaz Abdullah Sayeedi

Large Language Models (LLMs) are powerful computational models trained on extensive corpora of human-readable text, enabling them to perform general-purpose language understanding and generation. LLMs have garnered significant attention in…

Computation and Language · Computer Science 2024-10-28 Liam Barkley , Brink van der Merwe

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

Computation and Language · Computer Science 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Recently, Large Language Models (LLMs) have witnessed remarkable performance as zero-shot task planners for robotic manipulation tasks. However, the open-loop nature of previous works makes LLM-based planning error-prone and fragile. On the…

Robotics · Computer Science 2025-03-18 Zhi Zheng , Qian Feng , Hang Li , Alois Knoll , Jianxiang Feng

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

LLMs often adopt an assertive language style also when making false claims. Such ``overconfident hallucinations'' mislead users and erode trust. Achieving the ability to express in language the actual degree of uncertainty around a claim is…

Computation and Language · Computer Science 2025-04-24 Ziwei Ji , Lei Yu , Yeskendir Koishekenov , Yejin Bang , Anthony Hartshorn , Alan Schelten , Cheng Zhang , Pascale Fung , Nicola Cancedda

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

Computation and Language · Computer Science 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

Computation and Language · Computer Science 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

Large language models (LLMs) exhibit extensive medical knowledge but are prone to hallucinations and inaccurate citations, which pose a challenge to their clinical adoption and regulatory compliance. Current methods, such as Retrieval…