English

GeoProp: Grounding Robot State in Vision for Generalist Manipulation

Robotics 2026-07-08 v1 Artificial Intelligence

Abstract

Proprioception is fundamental to robotic manipulation, yet standard fusion methods often treat it as an isolated vector lacking explicit alignment with visual tokens. Without a direct correspondence between 3D kinematics and 2D feature maps, manipulation policies struggle to ground the robot's state within the scene, frequently underperforming even vision-only baselines. To address this, we introduce GeoProp, a lightweight, plug-and-play adapter that aligns proprioception with vision through explicit geometric grounding and spatial feature sampling. GeoProp projects the robot state onto the image plane to sample localized visual features, constructing a grounded state token. It then injects state-derived spatial priors into the corresponding visual features via FiLM modulation. To capture motion intent, GeoProp further samples features at a short-horizon predicted coordinate derived from recent kinematics, providing look-ahead visual context. Across 67 tasks, GeoProp improves Diffusion Policy by 8.7% on 63 simulation tasks and pi_0 by 4.0% on the RoboTwin subset, and yields a 10.6% average gain across both policy families in the real world, while adding only 2-3% to the parameter count. These results demonstrate that GeoProp is a simple yet high-impact inductive bias for generalist embodied policies. Project page: https://alibaba-damo-academy.github.io/GeoProp/.

Keywords

Cite

@article{arxiv.2607.07101,
  title  = {GeoProp: Grounding Robot State in Vision for Generalist Manipulation},
  author = {Guoyang Zhao and Quanhao Qian and Gongjie Zhang and Wenhao Li and Jiuniu Wang and Xiaowei Lu and Deli Zhao and Ran Xu},
  journal= {arXiv preprint arXiv:2607.07101},
  year   = {2026}
}

Comments

21 pages, 8 figures, 11 tables. Project page: https://alibaba-damo-academy.github.io/GeoProp/