English

$π\mathbf{R}^2$: Reactive Real-time Flow Policies

Robotics 2026-07-28 v1 Artificial Intelligence Machine Learning

Abstract

Generalist manipulation policies increasingly take the form of action-chunking flow policies built on large pretrained backbones. Such chunks run open-loop, so the policy cannot react to sensory input arriving mid-execution, sacrificing \emph{reactivity}. Replanning more often would restore it, but the perception-to-action pipeline (a large backbone plus multiple denoising steps) is too slow: this \emph{latency} forbids frequent replanning and leaves committed actions stale, making such policies ill-suited for dynamic, closed-loop control. We present πR2\pi\mathbf{R}^2, which makes these policies reactive and real-time while retaining large backbones, expressive multi-modal policies, and multi-action prediction. Built on the per-position noise schedule of diffusion forcing, πR2\pi\mathbf{R}^2 contributes two ideas. First, it splits conditioning into a fast channel (proprioception, fresh every tick) and an asynchronously updated slow channel (vision-language features), so the policy reacts to proprioception within a chunk while tolerating stale vision. Second, a latency-adaptive flow schedule treats in-flight actions as inpainting conditioning and emits actions in one denoising step per call, letting one trained model adapt to varying hardware latency. Requiring minimal modification to existing architectures, πR2\pi\mathbf{R}^2 can be finetuned from a pretrained policy: applied to GR00T-N1.7 on a real xArm6+XHand platform, it replans closed-loop roughly 4×4\times faster than the base policy (~2525Hz on an A5000 GPU), acting on a fresh observation every 4040ms. Across simulation and real-world manipulation tasks, πR2\pi\mathbf{R}^2 improves the success rate by up to 23%23\% in simulation and 30%30\% in the real world over the strongest baseline. Project page: https://pi-r2-flow.github.io/

Cite

@article{arxiv.2607.26055,
  title  = {$π\mathbf{R}^2$: Reactive Real-time Flow Policies},
  author = {Sungjae Park and Shubham Tulsiani},
  journal= {arXiv preprint arXiv:2607.26055},
  year   = {2026}
}

Comments

Preprint(20 pages). Under Review