English

Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving

Robotics 2026-03-10 v1 Artificial Intelligence

Abstract

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through latent imagination, existing approaches often lack explicit mechanisms to encode spatial and kinematic structure essential for driving tasks. In this work, we build upon the Recurrent State-Space Model (RSSM) and propose a kinematics-aware latent world model framework for autonomous driving. Vehicle kinematic information is incorporated into the observation encoder to ground latent transitions in physically meaningful motion dynamics, while geometry-aware supervision regularizes the RSSM latent state to capture task-relevant spatial structure beyond pixel reconstruction. The resulting structured latent dynamics improve long-horizon imagination fidelity and stabilize policy optimization. Experiments in a driving simulation benchmark demonstrate consistent gains over both model-free and pixel-based world-model baselines in terms of sample efficiency and driving performance. Ablation studies further verify that the proposed design enhances spatial representation quality within the latent space. These results suggest that integrating kinematic grounding into RSSM-based world models provides a scalable and physically grounded paradigm for autonomous driving policy learning.

Keywords

Cite

@article{arxiv.2603.07264,
  title  = {Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving},
  author = {Jiazhuo Li and Linjiang Cao and Qi Liu and Xi Xiong},
  journal= {arXiv preprint arXiv:2603.07264},
  year   = {2026}
}

Comments

6 pages, 5 figures. Under review at IEEE ITSC

R2 v1 2026-07-01T11:08:35.410Z