English

Embedding Morphology into Transformers for Cross-Robot Policy Learning

Robotics 2026-03-03 v1 Artificial Intelligence Machine Learning Systems and Control Systems and Control

Abstract

Cross-robot policy learning -- training a single policy to perform well across multiple embodiments -- remains a central challenge in robot learning. Transformer-based policies, such as vision-language-action (VLA) models, are typically embodiment-agnostic and must infer kinematic structure purely from observations, which can reduce robustness across embodiments and even limit performance within a single embodiment. We propose an embodiment-aware transformer policy that injects morphology via three mechanisms: (1) kinematic tokens that factorize actions across joints and compress time through per-joint temporal chunking; (2) a topology-aware attention bias that encodes kinematic topology as an inductive bias in self-attention, encouraging message passing along kinematic edges; and (3) joint-attribute conditioning that augments topology with per-joint descriptors to capture semantics beyond connectivity. Across a range of embodiments, this structured integration consistently improves performance over a vanilla pi0.5 VLA baseline, indicating improved robustness both within an embodiment and across embodiments.

Keywords

Cite

@article{arxiv.2603.00182,
  title  = {Embedding Morphology into Transformers for Cross-Robot Policy Learning},
  author = {Kei Suzuki and Jing Liu and Ye Wang and Chiori Hori and Matthew Brand and Diego Romeres and Toshiaki Koike-Akino},
  journal= {arXiv preprint arXiv:2603.00182},
  year   = {2026}
}

Comments

17 pages, 8 figures (including appendix)

R2 v1 2026-07-01T10:56:23.397Z