English
Related papers

Related papers: Training Language Models on the Knowledge Graph: I…

200 papers

Prior works have shown that fine-tuning on new knowledge can induce factual hallucinations in large language models (LLMs), leading to incorrect outputs when evaluated on previously known information. However, the specific manifestations of…

Computation and Language · Computer Science 2026-04-20 Renfei Dang , Peng Hu , Zhejian Lai , Changjiang Gao , Min Zhang , Shujian Huang

Large language models (LLMs) have revolutionized natural language processing, yet their tendency to hallucinate poses serious challenges for reliable deployment. Despite numerous hallucination detection methods, their evaluations often rely…

Computation and Language · Computer Science 2025-08-15 Denis Janiak , Jakub Binkowski , Albert Sawczyn , Bogdan Gabrys , Ravid Shwartz-Ziv , Tomasz Kajdanowicz

Knowledge-grounded conversational models are known to suffer from producing factually invalid statements, a phenomenon commonly called hallucination. In this work, we investigate the underlying causes of this phenomenon: is hallucination…

Computation and Language · Computer Science 2022-04-19 Nouha Dziri , Sivan Milton , Mo Yu , Osmar Zaiane , Siva Reddy

How to alleviate the hallucinations of Large Language Models (LLMs) has always been the fundamental goal pursued by the LLMs research community. Looking through numerous hallucination-related studies, a mainstream category of methods is to…

Computation and Language · Computer Science 2025-02-12 Yinghui Li , Haojing Huang , Jiayi Kuang , Yangning Li , Shu-Yu Guo , Chao Qu , Xiaoyu Tan , Hai-Tao Zheng , Ying Shen , Philip S. Yu

Large language models (LLMs) have demonstrated remarkable capabilities, but they still frequently produce hallucinations. These hallucinations are difficult to detect in reasoning-intensive tasks, where the content appears coherent but…

Computation and Language · Computer Science 2026-05-13 Rui Min , Tianyu Pang , Chao Du , Minhao Cheng , Yi R. Fung

This paper examines the capacity of LLMs to reason with knowledge graphs using their internal knowledge graph, i.e., the knowledge graph they learned during pre-training. Two research questions are formulated to investigate the accuracy of…

Computation and Language · Computer Science 2023-12-04 Pei-Chi Lo , Yi-Hang Tsai , Ee-Peng Lim , San-Yih Hwang

Large Vision-Language Models (LVLMs) have recently demonstrated remarkable progress, yet hallucination remains a critical barrier, particularly in chart understanding, which requires sophisticated perceptual and cognitive abilities as well…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xingqi Wang , Yiming Cui , Xin Yao , Shijin Wang , Guoping Hu , Xiaoyu Qin

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Large language model (LLM) systems suffer from the models' unstable ability to generate valid and factual content, resulting in hallucination generation. Current hallucination detection methods heavily rely on out-of-model information…

Computation and Language · Computer Science 2025-02-20 Peiran Wang , Yang Liu , Yunfei Lu , Jue Hong , Ye Wu

Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinformation. Existing hallucination evaluation, however, focuses…

Machine Learning · Computer Science 2026-02-03 Prakhar Ganesh , Reza Shokri , Golnoosh Farnadi

The widespread adoption of large language and vision models in real-world applications has made urgent the need to address hallucinations -- instances where models produce incorrect or nonsensical outputs. These errors can propagate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhengyi Ho , Siyuan Liang , Dacheng Tao

Large language models (LLMs) can generate fluent responses, but sometimes hallucinate facts. In this paper, we investigate whether LLMs can detect their own hallucinations. We formulate hallucination detection as a classification task of a…

Computation and Language · Computer Science 2025-11-17 Sora Kadotani , Kosuke Nishida , Kyosuke Nishida

Large language models (LLMs) possess extensive world knowledge, including geospatial knowledge, which has been successfully applied to various geospatial tasks such as mobility prediction and social indicator prediction. However, LLMs often…

Computation and Language · Computer Science 2025-07-29 Shengyuan Wang , Jie Feng , Tianhui Liu , Dan Pei , Yong Li

Hallucinations in Speech Large Language Models (SpeechLLMs) pose significant risks, yet existing detection methods typically rely on gold-standard outputs that are costly or impractical to obtain. Moreover, hallucination detection methods…

Computation and Language · Computer Science 2026-04-22 Jonas Waldendorf , Bashar Awwad Shiekh Hasan , Evgenii Tsymbalov

Recent works integrating Knowledge Graphs (KGs) have shown promising improvements in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing benchmarks primarily focus on closed-ended tasks, leaving a gap in…

Computation and Language · Computer Science 2025-05-23 Yuan Sui , Yufei He , Zifeng Ding , Bryan Hooi

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

Computers and Society · Computer Science 2025-09-23 Richard Ackermann , Simeon Emanuilov

Large Language Models (LLMs) are optimized to produce distributionally plausible continuations rather than to explicitly verify whether generated propositions are entailed by source documents. This inductive bias enables generalization, but…

Computation and Language · Computer Science 2026-05-25 Paul Landes , Pranav Herur , Adam Cross , Jimeng Sun

Concerns regarding the propensity of Large Language Models (LLMs) to produce inaccurate outputs, also known as hallucinations, have escalated. Detecting them is vital for ensuring the reliability of applications relying on LLM-generated…

Computation and Language · Computer Science 2024-05-31 Ernesto Quevedo , Jorge Yero , Rachel Koerner , Pablo Rivas , Tomas Cerny

Large-scale vision-language models have demonstrated impressive skill in handling tasks that involve both areas. Nevertheless, these models frequently experience significant issues with generating inaccurate information, which is…

Computation and Language · Computer Science 2024-05-07 Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller