English

Encoder-Free Knowledge-Graph Reasoning with LLMs via Hyperdimensional Path Retrieval

Machine Learning 2026-02-04 v2 Computation and Language

Abstract

Recent progress in large language models (LLMs) has made knowledge-grounded reasoning increasingly practical, yet KG-based QA systems often pay a steep price in efficiency and transparency. In typical pipelines, symbolic paths are scored by neural encoders or repeatedly re-ranked by multiple LLM calls, which inflates latency and GPU cost and makes the decision process hard to audit. We introduce PathHD, an encoder-free framework for knowledge-graph reasoning that couples hyperdimensional computing (HDC) with a single LLM call per query. Given a query, PathHD represents relation paths as block-diagonal GHRR hypervectors, retrieves candidate paths using a calibrated blockwise cosine similarity with Top-K pruning, and then performs a one-shot LLM adjudication that outputs the final answer together with supporting, citeable paths. The design is enabled by three technical components: (i) an order-sensitive, non-commutative binding operator for composing multi-hop paths, (ii) a robust similarity calibration that stabilizes hypervector retrieval, and (iii) an adjudication stage that preserves interpretability while avoiding per-path LLM scoring. Across WebQSP, CWQ, and GrailQA, PathHD matches or improves Hits@1 compared to strong neural baselines while using only one LLM call per query, reduces end-to-end latency by 4060%40-60\%, and lowers GPU memory by 35×3-5\times due to encoder-free retrieval. Overall, the results suggest that carefully engineered HDC path representations can serve as an effective substrate for efficient and faithful KG-LLM reasoning, achieving a strong accuracy-efficiency-interpretability trade-off.

Keywords

Cite

@article{arxiv.2512.09369,
  title  = {Encoder-Free Knowledge-Graph Reasoning with LLMs via Hyperdimensional Path Retrieval},
  author = {Yezi Liu and William Youngwoo Chung and Hanning Chen and Calvin Yeung and Mohsen Imani},
  journal= {arXiv preprint arXiv:2512.09369},
  year   = {2026}
}
R2 v1 2026-07-01T08:18:25.629Z