English

Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection

Robotics 2026-04-16 v1

Abstract

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle in long-horizon, memory-dependent tasks with partial observability, occlusions, and multi-stage dependencies. Such tasks require not only precise visuomotor control, but also persistent memory, adaptive task decomposition, and explicit recovery from execution failures. To address these limitations, we propose a dual-system framework for long-horizon embodied manipulation. Our framework explicitly separates high-level semantic reasoning from low-level motor execution. A high-level planner, implemented as a VLM-based agentic module, maintains structured task memory and performs goal decomposition, outcome verification, and error-driven correction. A low-level executor, instantiated as a VLA-based visuomotor controller, carries out each sub-task through diffusion-based action generation conditioned on geometry-preserving filtered observations. Together, the two systems form a closed loop between planning and execution, enabling memory-aware reasoning, adaptive replanning, and robust online recovery. Experiments on representative RMBench tasks show that the proposed framework substantially outperforms representative baselines, achieving a 32.4% average success rate compared with 9.8% for the strongest baseline. Ablation studies further confirm the importance of structured memory and closed-loop recovery for long-horizon manipulation.

Keywords

Cite

@article{arxiv.2604.13942,
  title  = {Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection},
  author = {Zhen Liu and Xinyu Ning and Zhe Hu and Xinxin Xie and Weize Li and Zhipeng Tang and Chongyu Wang and Zejun Yang and Hanlin Wang and Yitong Liu and Zhongzhu Pu},
  journal= {arXiv preprint arXiv:2604.13942},
  year   = {2026}
}
R2 v1 2026-07-01T12:10:52.873Z