English

WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems

Machine Learning 2026-05-21 v2 Robotics

Abstract

Trajectory world models play a crucial role in robotic dynamics learning, planning, and control. While recent works have explored trajectory world models for diverse robotic systems, they struggle to scale to a large number of distinct system dynamics and overlook domain knowledge of physical structures. To address these limitations, we introduce WestWorld, a knoWledge-Encoded Scalable Trajectory World model for diverse robotic systems. To tackle the scalability challenge, we propose a novel system-aware Mixture-of-Experts (Sys-MoE) that dynamically combines and routes specialized experts for different robotic systems via a learnable system embedding. To further enhance zero-shot generalization, we incorporate domain knowledge of robot physical structures by introducing a structural embedding that aligns trajectory representations with morphological information. After pretraining on 89 complex environments spanning diverse morphologies across both simulation and real-world settings, WestWorld achieves significant improvements over competitive baselines in zero- and few-shot trajectory prediction. Additionally, it shows strong scalability across a wide range of robotic environments and significantly improves performance on downstream model-based control for different robots. Finally, we deploy our model on a real-world Unitree Go1, where it demonstrates stable locomotion performance. The code is available at https://github.com/511205787/WestWorld.

Keywords

Cite

@article{arxiv.2603.14392,
  title  = {WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems},
  author = {Yuchen Wang and Jiangtao Kong and Sizhe Wei and Xiaochang Li and Haohong Lin and Hongjue Zhao and Tianyi Zhou and Lu Gan and Huajie Shao},
  journal= {arXiv preprint arXiv:2603.14392},
  year   = {2026}
}

Comments

ICML 2026 spotlight

R2 v1 2026-07-01T11:20:44.324Z