English

Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation

Computation and Language 2025-08-08 v2 Human-Computer Interaction

Abstract

Large Language Models (LLMs) succeed in many natural language processing tasks. However, their tendency to hallucinate - generate plausible but inconsistent or factually incorrect text - can cause significant problems in certain tasks, including response generation in dialogue. To mitigate this issue, we propose two novel graph knowledge-augmented frameworks, Dialogue Response Generation via Textualised Graphs (TG-DRG) and Graph-Aware Dialogue Response Generation (GA-DRG), which combine reasoning-guided dialogue reformulation, dialogue sense knowledge selection, and graph-enhanced response generation to improve the factuality of dialogue responses. To evaluate the factuality of generated responses, we propose a dialogue fact score that addresses the limitations of existing fact-score methods in dialogue settings, providing a more reliable assessment of factual consistency. We evaluate our methods using different baselines on the OpendialKG and HybriDialogue datasets. Our methods noticeably improve factuality compared to other graph knowledge-augmentation baselines, including the state-of-the-art G-retriever, achieving improvements of 3.47% on OpendialKG and 3.12% on HybriDialogue in terms of dialogue fact score. The code will be released on GitHub.

Keywords

Cite

@article{arxiv.2506.12496,
  title  = {Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation},
  author = {Xiangyan Chen and Yujian Gan and Yimeng Gu and Matthew Purver},
  journal= {arXiv preprint arXiv:2506.12496},
  year   = {2025}
}
R2 v1 2026-07-01T03:17:44.914Z