DocNavRAG: Document-Structured Graph RAG with Stateful Evidence Construction for Complex Document Question Answering
Abstract
Answering complex questions over large document collections requires assembling complementary evidence across sections and documents. GraphRAG offers structured retrieval but typically uses fixed traversal, while agentic RAG operates over weakly structured interfaces. Our key insight is that agents should navigate document structure within and across documents rather than repeatedly search from scratch. We introduce DocNavRAG, which organizes document hierarchies and cross-region relations into a navigable graph, exposes graph operations for locating, navigating, expanding, and fetching, and maintains an evolving evidence state to guide retrieval until sufficient evidence is collected. Across four long- and multi-document QA benchmarks, DocNavRAG improves answer quality and context sufficiency over the strongest baseline by 7.8\% and 17.7\% on average.
Cite
@article{arxiv.2608.01565,
title = {DocNavRAG: Document-Structured Graph RAG with Stateful Evidence Construction for Complex Document Question Answering},
author = {Dongyang Xie and Yao Tian and Hao Zhang and Yifei Yuan and Tieyun Qian and Ming Zhong and Jiawei Jiang and Yuanyuan Zhu},
journal= {arXiv preprint arXiv:2608.01565},
year = {2026}
}
Comments
19 pages, 5 figures, 16 tables