English

Retrieval as Generation: A Unified Framework with Self-Triggered Information Planning

Computation and Language 2026-04-21 v2 Artificial Intelligence

Abstract

We revisit retrieval-augmented generation (RAG) by embedding retrieval control directly into generation. Instead of treating retrieval as an external intervention, we express retrieval decisions within token-level decoding, enabling end-to-end coordination without additional controllers or classifiers. Under the paradigm of Retrieval as Generation, we propose \textbf{GRIP} (\textbf{G}eneration-guided \textbf{R}etrieval with \textbf{I}nformation \textbf{P}lanning), a unified framework in which the model regulates retrieval behavior through control-token emission. Central to GRIP is \textit{Self-Triggered Information Planning}, which allows the model to decide when to retrieve, how to reformulate queries, and when to terminate, all within a single autoregressive trajectory. This design tightly couples retrieval and reasoning and supports dynamic multi-step inference with on-the-fly evidence integration. To supervise these behaviors, we construct a structured training set covering answerable, partially answerable, and multi-hop queries, each aligned with specific token patterns. Experiments on five QA benchmarks show that GRIP surpasses strong RAG baselines and is competitive with GPT-4o while using substantially fewer parameters.

Keywords

Cite

@article{arxiv.2604.11407,
  title  = {Retrieval as Generation: A Unified Framework with Self-Triggered Information Planning},
  author = {Bo Li and Mingda Wang and Gexiang Fang and Shikun Zhang and Wei Ye},
  journal= {arXiv preprint arXiv:2604.11407},
  year   = {2026}
}

Comments

Github: https://github.com/WisdomShell/GRIP HuggingFace:https://huggingface.co/collections/WisdomShell/grip

R2 v1 2026-07-01T12:06:18.645Z