English

Coherent Rollout Oracles for Finite-Horizon Sequential Decision Problems

Quantum Physics 2026-04-30 v1 Data Structures and Algorithms

Abstract

Coherent quantum rollout for sequential decision problems requires a unitary simulator: randomness must live in explicit quantum registers, and basis-state selectors must be mapped to actions reversibly. With branch-dependent valid actions, this mapping is totalized coherent rank-select over an entangled NN-bit validity mask: return the position of the rr-th valid bit, or a sentinel if rr is out of range. We give the first reversible-circuit complexity analysis of this primitive. For selector width w=log2(N+1)w = \lceil \log_2(N+1) \rceil, rank-select admits an O(Nw)O(Nw)-gate low-ancilla bounded-span scan, proved gate-optimal in its model, and an O(Nlogw)O(N\log w)-gate low-ancilla blocked construction when long-range gates are available; across all bounded-fan-in layouts, the unconditional gate lower bound is Ω(N)\Omega(N). Composing rank-select with reversible transition and predicate-evaluation circuits gives an explicit polynomial-size coherent rollout oracle for finite-horizon planning problems satisfying these primitive assumptions. The resulting oracle satisfies the access model of the best-arm pipeline of Wang et al., yielding O~(k/ε)\widetilde{O}(\sqrt{k}/\varepsilon) coherent oracle calls against the standard classical Ω(k/ε2)\Omega(k/\varepsilon^2) arm-pull lower bound. We give a bounded-influence lifting theorem that extends this lower-bound construction from a base configuration to an exponential family of configurations. We instantiate the construction on SIR epidemic intervention, with a stochastic placement-game sanity check, and machine-check the main results in Lean 4. Code and proofs: https://github.com/BinRoot/b01t/tree/main/demos/rollout.

Keywords

Cite

@article{arxiv.2604.25962,
  title  = {Coherent Rollout Oracles for Finite-Horizon Sequential Decision Problems},
  author = {Nishant Shukla},
  journal= {arXiv preprint arXiv:2604.25962},
  year   = {2026}
}

Comments

10 pages + 1 page of references, submitted to QCE 2026

R2 v1 2026-07-01T12:39:48.949Z