English

GundamQ: Multi-Scale Spatio-Temporal Representation Learning for Robust Robot Path Planning

Robotics 2025-09-15 v1

Abstract

In dynamic and uncertain environments, robotic path planning demands accurate spatiotemporal environment understanding combined with robust decision-making under partial observability. However, current deep reinforcement learning-based path planning methods face two fundamental limitations: (1) insufficient modeling of multi-scale temporal dependencies, resulting in suboptimal adaptability in dynamic scenarios, and (2) inefficient exploration-exploitation balance, leading to degraded path quality. To address these challenges, we propose GundamQ: A Multi-Scale Spatiotemporal Q-Network for Robotic Path Planning. The framework comprises two key modules: (i) the Spatiotemporal Perception module, which hierarchically extracts multi-granularity spatial features and multi-scale temporal dependencies ranging from instantaneous to extended time horizons, thereby improving perception accuracy in dynamic environments; and (ii) the Adaptive Policy Optimization module, which balances exploration and exploitation during training while optimizing for smoothness and collision probability through constrained policy updates. Experiments in dynamic environments demonstrate that GundamQ achieves a 15.3\% improvement in success rate and a 21.7\% increase in overall path quality, significantly outperforming existing state-of-the-art methods.

Keywords

Cite

@article{arxiv.2509.10305,
  title  = {GundamQ: Multi-Scale Spatio-Temporal Representation Learning for Robust Robot Path Planning},
  author = {Yutong Shen and Ruizhe Xia and Bokai Yan and Shunqi zhang and Pengrui Xiang and Sicheng He and Yixin Xu},
  journal= {arXiv preprint arXiv:2509.10305},
  year   = {2025}
}

Comments

6 pages, 5 figures

R2 v1 2026-07-01T05:33:36.885Z