English

Q-SpiRL: Quantum Spiking Reinforcement Learning for Adaptive Robot Navigation

Robotics 2026-05-21 v1 Quantum Physics

Abstract

Adaptive robot navigation in dynamic environments requires policies that can reach the target reliably while producing efficient and stable trajectories. This paper presents Q-SpiRL, a quantum spiking reinforcement learning framework for obstacle-aware robot navigation. The framework develops and evaluates five agent families: tabular Q-learning, classical MLP, classical SNN, quantum-enhanced MLP (QMLP), and quantum-enhanced spiking neural network (QSNN). While all models are implemented under a unified training and evaluation pipeline, the QSNN is the central architecture of interest, as it combines spike-based temporal processing with variational quantum feature transformation. Experiments are conducted across three grid-world environments of increasing size, namely 20x20, 30x30, and 40x40, with both static and dynamic obstacles. Performance is assessed using success rate, success-weighted path length, path length, and turn rate under deterministic inference. Results show that QSNN achieves the strongest overall trade-off between task completion, trajectory efficiency, and motion smoothness, reaching up to 99% success rate while maintaining high path efficiency in the most challenging setting. Execution on IBM quantum hardware further demonstrates the feasibility of deploying the proposed hybrid policy under real-device conditions.

Keywords

Cite

@article{arxiv.2605.20801,
  title  = {Q-SpiRL: Quantum Spiking Reinforcement Learning for Adaptive Robot Navigation},
  author = {Mohamed Khair Altrabulsi and Nouhaila Innan and Alberto Marchisio and Muhammad Kashif and Muhammad Shafique},
  journal= {arXiv preprint arXiv:2605.20801},
  year   = {2026}
}

Comments

11 pages, 6 figures

R2 v1 2026-07-22T07:23:21.206Z