Coherent Rollout Oracles for Finite-Horizon Sequential Decision Problems
Abstract
Coherent quantum rollout for sequential decision problems requires a unitary simulator: randomness must live in explicit quantum registers, and basis-state selectors must be mapped to actions reversibly. With branch-dependent valid actions, this mapping is totalized coherent rank-select over an entangled -bit validity mask: return the position of the -th valid bit, or a sentinel if is out of range. We give the first reversible-circuit complexity analysis of this primitive. For selector width , rank-select admits an -gate low-ancilla bounded-span scan, proved gate-optimal in its model, and an -gate low-ancilla blocked construction when long-range gates are available; across all bounded-fan-in layouts, the unconditional gate lower bound is . Composing rank-select with reversible transition and predicate-evaluation circuits gives an explicit polynomial-size coherent rollout oracle for finite-horizon planning problems satisfying these primitive assumptions. The resulting oracle satisfies the access model of the best-arm pipeline of Wang et al., yielding coherent oracle calls against the standard classical arm-pull lower bound. We give a bounded-influence lifting theorem that extends this lower-bound construction from a base configuration to an exponential family of configurations. We instantiate the construction on SIR epidemic intervention, with a stochastic placement-game sanity check, and machine-check the main results in Lean 4. Code and proofs: https://github.com/BinRoot/b01t/tree/main/demos/rollout.
Cite
@article{arxiv.2604.25962,
title = {Coherent Rollout Oracles for Finite-Horizon Sequential Decision Problems},
author = {Nishant Shukla},
journal= {arXiv preprint arXiv:2604.25962},
year = {2026}
}
Comments
10 pages + 1 page of references, submitted to QCE 2026