English

Learning Generalizable Visuomotor Policy through Dynamics-Alignment

Robotics 2025-11-03 v1 Machine Learning

Abstract

Behavior cloning methods for robot learning suffer from poor generalization due to limited data support beyond expert demonstrations. Recent approaches leveraging video prediction models have shown promising results by learning rich spatiotemporal representations from large-scale datasets. However, these models learn action-agnostic dynamics that cannot distinguish between different control inputs, limiting their utility for precise manipulation tasks and requiring large pretraining datasets. We propose a Dynamics-Aligned Flow Matching Policy (DAP) that integrates dynamics prediction into policy learning. Our method introduces a novel architecture where policy and dynamics models provide mutual corrective feedback during action generation, enabling self-correction and improved generalization. Empirical validation demonstrates generalization performance superior to baseline methods on real-world robotic manipulation tasks, showing particular robustness in OOD scenarios including visual distractions and lighting variations.

Keywords

Cite

@article{arxiv.2510.27114,
  title  = {Learning Generalizable Visuomotor Policy through Dynamics-Alignment},
  author = {Dohyeok Lee and Jung Min Lee and Munkyung Kim and Seokhun Ju and Jin Woo Koo and Kyungjae Lee and Dohyeong Kim and TaeHyun Cho and Jungwoo Lee},
  journal= {arXiv preprint arXiv:2510.27114},
  year   = {2025}
}

Comments

9 pages, 6 figures

R2 v1 2026-07-01T07:14:59.311Z