English

RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimization

Computer Vision and Pattern Recognition 2026-04-14 v2

Abstract

Scalable Embodied AI faces fundamental constraints due to prohibitive costs and safety risks of real-world interaction. While Embodied World Models (EWMs) offer promise through imagined rollouts, existing approaches suffer from geometric hallucinations and lack unified optimization frameworks for practical policy improvement. We introduce RoboStereo, a symmetric dual-tower 4D world model that employs bidirectional cross-modal enhancement to ensure spatiotemporal geometric consistency and alleviate physics hallucinations. Building upon this high-fidelity 4D simulator, we present the first unified framework for world-model-based policy optimization: (1) Test-Time Policy Augmentation (TTPA) for pre-execution verification, (2) Imitative-Evolutionary Policy Learning (IEPL) leveraging visual perceptual rewards to learn from expert demonstrations, and (3) Open-Exploration Policy Learning (OEPL) enabling autonomous skill discovery and self-correction. Comprehensive experiments demonstrate RoboStereo achieves state-of-the-art generation quality, with our unified framework delivering >97% average relative improvement on fine-grained manipulation tasks.

Keywords

Cite

@article{arxiv.2603.12639,
  title  = {RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimization},
  author = {Ruicheng Zhang and Guangyu Chen and Zunnan Xu and Zihao Liu and Zhizhou Zhong and Mingyang Zhang and Jun Zhou and Xiu Li},
  journal= {arXiv preprint arXiv:2603.12639},
  year   = {2026}
}
R2 v1 2026-07-01T11:17:52.747Z