English

Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision

Robotics 2026-06-29 v1 Computer Vision and Pattern Recognition

Abstract

Cross-embodiment transfer in vision-language-action (VLA) models remains challenging because low-level state and action spaces differ fundamentally across robot platforms. We observe that the high-level cognitive process underlying manipulation, including scene perception, object identification, task planning, and sub-task decomposition, is largely shared across embodiments. Based on this observation, we present ZR-0, a 2.6 billion parameter end-to-end VLA model that uses dense Embodied Chain-of-Thought (ECoT) supervision to align cross-embodiment representations within the vision-language model (VLM). ZR-0 adopts a dual-stream architecture: a pre-trained VLM (System 2) generates structured ECoT reasoning during training, while a Diffusion Transformer-based action expert (System 1) produces continuous action chunks via flow matching. The two components are coupled through cross-attention, with an attention mask that restricts the action expert to input prompt features only, enabling ECoT generation to be entirely skipped at inference without any performance loss. ZR-0 is pre-trained on ProcCorpus-60M, a large-scale dataset comprising approximately 60 million frames (approximately 1,000 hours) from over 400K trajectories, with dense ECoT annotations covering 96.8% of all frames. We evaluate ZR-0 on three simulation benchmarks spanning single-arm (LIBERO), bimanual (RoboTwin 2.0), and humanoid (RoboCasa GR-1 Tabletop) embodiments, as well as real-world experiments on the xArm platform, demonstrating strong performance across all settings. Code and model checkpoints are available at https://github.com/RUCKBReasoning/ZR-0.

Keywords

Cite

@article{arxiv.2606.30552,
  title  = {Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision},
  author = {Haoyang Li and Guanlin Li and Youhe Feng and Chen Zhao and Zhuoran Wang and Yang Li and Qizhe Wei and Shifeng Bao and Haitao Shen and Yihan Zhao and Tong Yang and Jing Zhang},
  journal= {arXiv preprint arXiv:2606.30552},
  year   = {2026}
}