English

Noise or Nuance: An Investigation Into Useful Information and Filtering For LLM Driven AKBC

Computation and Language 2025-09-12 v1

Abstract

RAG and fine-tuning are prevalent strategies for improving the quality of LLM outputs. However, in constrained situations, such as that of the 2025 LM-KBC challenge, such techniques are restricted. In this work we investigate three facets of the triple completion task: generation, quality assurance, and LLM response parsing. Our work finds that in this constrained setting: additional information improves generation quality, LLMs can be effective at filtering poor quality triples, and the tradeoff between flexibility and consistency with LLM response parsing is setting dependent.

Keywords

Cite

@article{arxiv.2509.08903,
  title  = {Noise or Nuance: An Investigation Into Useful Information and Filtering For LLM Driven AKBC},
  author = {Alex Clay and Ernesto Jiménez-Ruiz and Pranava Madhyastha},
  journal= {arXiv preprint arXiv:2509.08903},
  year   = {2025}
}

Comments

8 pages, 1 figure, accepted to the ISWC 2025 LM-KBC Workshop