English
Related papers

Related papers: KG-FPQ: Evaluating Factuality Hallucination in LLM…

200 papers

Knowledge Graph(KG) grounded conversations often use large pre-trained models and usually suffer from fact hallucination. Frequently entities with no references in knowledge sources and conversation history are introduced into responses,…

Computation and Language · Computer Science 2023-01-12 Souvik Das , Sougata Saha , Rohini K. Srihari

Large Language Models (LLMs) have shown unprecedented performance in various real-world applications. However, they are known to generate factually inaccurate outputs, a.k.a. the hallucination problem. In recent years, incorporating…

Computation and Language · Computer Science 2024-06-21 Haochen Liu , Song Wang , Yaochen Zhu , Yushun Dong , Jundong Li

We introduce fs1, a simple yet effective method that improves the factuality of reasoning traces by collecting them from large reasoning models and grounding them in knowledge graph (KG) paths. We fine-tune eight instruction-tuned Large…

Computation and Language · Computer Science 2026-04-21 Mike Zhang , Johannes Bjerva , Russa Biswas

Large Language Models (LLMs) often struggle to align their responses with objective facts, resulting in the issue of factual hallucinations, which can be difficult to detect and mislead users without relevant knowledge. Although…

Computation and Language · Computer Science 2025-10-14 Siyuan Zhang , Yichi Zhang , Yinpeng Dong , Hang Su

Hallucination, a persistent challenge plaguing language models, undermines their efficacy and trustworthiness in various natural language processing endeavors by generating responses that deviate from factual accuracy or coherence. This…

Computation and Language · Computer Science 2024-12-30 Ratnesh Kumar Joshi , Sagnik Sengupta , Asif Ekbal

Knowledge graphs (KGs) are vital for knowledge-intensive tasks and have shown promise in reducing hallucinations in large language models (LLMs). However, constructing high-quality KGs remains difficult, requiring accurate information…

Computation and Language · Computer Science 2025-10-14 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Bo Xiong , Fiona Liausvia , Dongkyu Choi , Boon Kiat Quek

Generative Large Language Models (LLMs) such as GPT-3 are capable of generating highly fluent responses to a wide variety of user prompts. However, LLMs are known to hallucinate facts and make non-factual statements which can undermine…

Computation and Language · Computer Science 2023-10-12 Potsawee Manakul , Adian Liusie , Mark J. F. Gales

Integrating knowledge graphs (KGs) to enhance the reasoning capabilities of large language models (LLMs) is an emerging research challenge in claim verification. While KGs provide structured, semantically rich representations well-suited…

Computation and Language · Computer Science 2025-05-29 Hoang Pham , Thanh-Do Nguyen , Khac-Hoai Nam Bui

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

Computation and Language · Computer Science 2025-12-30 Sahil Kale , Antonio Luca Alfeo

Large language models (LLMs) have demonstrated remarkable capabilities in various scientific domains, from natural language processing to complex problem-solving tasks. Their ability to understand and generate human-like text has opened up…

Computation and Language · Computer Science 2024-11-05 Guangzhi Xiong , Eric Xie , Amir Hassan Shariatmadari , Sikun Guo , Stefan Bekiranov , Aidong Zhang

Large language models (LLMs) are notorious for hallucinating, i.e., producing erroneous claims in their output. Such hallucinations can be dangerous, as occasional factual inaccuracies in the generated text might be obscured by the rest of…

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating…

Artificial Intelligence · Computer Science 2024-03-05 Yilin Wen , Zifeng Wang , Jimeng Sun

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

Large Language Models (LLMs) succeed in many natural language processing tasks. However, their tendency to hallucinate - generate plausible but inconsistent or factually incorrect text - can cause significant problems in certain tasks,…

Computation and Language · Computer Science 2025-08-08 Xiangyan Chen , Yujian Gan , Yimeng Gu , Matthew Purver

Despite the superb performance in many tasks, large language models (LLMs) bear the risk of generating hallucination or even wrong answers when confronted with tasks that demand the accuracy of knowledge. The issue becomes even more…

Information Retrieval · Computer Science 2024-12-16 Lihui Liu , Zihao Wang , Ruizhong Qiu , Yikun Ban , Eunice Chan , Yangqiu Song , Jingrui He , Hanghang Tong

To address the issues of insufficient knowledge and hallucination in Large Language Models (LLMs), numerous studies have explored integrating LLMs with Knowledge Graphs (KGs). However, these methods are typically evaluated on conventional…

Computation and Language · Computer Science 2024-10-08 Yao Xu , Shizhu He , Jiabei Chen , Zihao Wang , Yangqiu Song , Hanghang Tong , Guang Liu , Kang Liu , Jun Zhao

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

We present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering. Traditional approaches often require detailed knowledge of a graph…

Computation and Language · Computer Science 2025-02-11 Harry Li , Gabriel Appleby , Ashley Suh

Knowledge graphs (KGs) are powerful data structures, but exploring them effectively remains difficult for even expert users. Large language models (LLMs) are increasingly used to address this gap, yet little is known empirically about how…

Machine Learning · Computer Science 2025-05-29 Harry Li , Gabriel Appleby , Kenneth Alperin , Steven R Gomez , Ashley Suh