English

Enabling Extensible Embodied Capabilities with Tools

Robotics 2026-05-27 v1

Abstract

Most existing embodied intelligence methods formulate perception, reasoning, planning, and control within a unified parameterized policy. Yet these capabilities are inherently hierarchical and heterogeneous, making them difficult to reliably learn and modularize within a single model. We propose a capability externalization approach that decouples heterogeneous capabilities into independently optimized tools, dynamically invoked at inference time. To this end, we introduce Embodied Tool Protocol (ETP), a standardized protocol for embodied tool registration, discovery, invocation, and execution, and curate 100+ validated tools spanning perception, cognition, reasoning, and execution as the tool base. Building on this, we construct EmbodiedToolBench to evaluate both whether tool augmentation improves embodied performance and how well current models use tools across tool-necessity recognition, tool selection, tool execution, and tool-chain composition. Experiments across simulation and real-world platforms confirm that capability externalization consistently improves embodied performance (avg. gain 31% on EB-ALFRED and 36% on EB-Navigation), yet reveal a clear boundary: gains are substantial for cognition and perception but are limited for execution-type capabilities. Moreover, our analysis reveals that knowing when, which, and how to invoke tools remains a persistent challenge across all models, thereby highlighting embodied tool competence as a critical direction for future research.

Keywords

Cite

@article{arxiv.2605.26637,
  title  = {Enabling Extensible Embodied Capabilities with Tools},
  author = {Xueyang Zhou and Zijia Wang and Qianjiang Li and Yibo Hu and Guiyao Tie and Li Wan and Yidan Liu and Pan Zhou and Lichao Sun and Yongchao Chen},
  journal= {arXiv preprint arXiv:2605.26637},
  year   = {2026}
}

Comments

51 pages, 20 figures,