English

CLAW: Composable Language-Annotated Whole-body Motion Generation

Robotics 2026-04-20 v3

Abstract

Training language-conditioned whole-body controllers for humanoid robots demands large-scale motion-language datasets. Existing approaches based on motion capture are costly and limited in diversity, while text-to-motion generative models produce purely kinematic outputs that are not guaranteed to be physically feasible. We present CLAW, a pipeline for scalable generation of language-annotated whole-body motion data for the Unitree G1 humanoid robot. CLAW composes motion primitives from a kinematic planner, parameterized by movement, heading, speed, pelvis height, and duration, and provides two browser-based interfaces--a real-time keyboard mode and a timeline-based sequence editor--for exploratory and batch data collection. A low-level controller tracks these references in MuJoCo simulation, yielding physically grounded trajectories. In parallel, a template-based engine generates diverse natural-language annotations at both segment and trajectory levels. To support scalable generation of motion-language paired data for humanoid robot learning, we make our system publicly available at: https://github.com/JianuoCao/CLAW

Cite

@article{arxiv.2604.11251,
  title  = {CLAW: Composable Language-Annotated Whole-body Motion Generation},
  author = {Jianuo Cao and Yuxin Chen and Masayoshi Tomizuka},
  journal= {arXiv preprint arXiv:2604.11251},
  year   = {2026}
}
R2 v1 2026-07-01T12:06:01.209Z