English

EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing

Computer Vision and Pattern Recognition 2026-05-14 v1

Abstract

With recent advances in embodied agents and AR devices, egocentric observations are readily available as input for real-world interactive online applications. However, egocentric viewpoints can only sporadically observe hands, in addition to the estimated head trajectory. We propose EgoForce, an online framework for reconstructing long-term full-body motion from noisy egocentric input. While existing generative frameworks can robustly handle noisy and sparse measurements, they assume a fixed-length observation window is available and are thus not suitable for real-time applications. Faster inference often relies on autoregressive prediction, sacrificing robustness. In contrast, we adopt a diffusion-based method with a temporally asymmetric noise schedule inspired by Diffusion Forcing. Specifically, our approach models temporally evolving uncertainty and incrementally denoises states as new streaming observations arrive. Combined with a noise-robust imputation strategy, EgoForce progressively generates stable and coherent full-body motion under strict causal constraints. Experiments demonstrate that our online framework outperforms existing online and offline methods, enabling long-horizon, full-body motion reconstruction in challenging egocentric scenarios.

Keywords

Cite

@article{arxiv.2605.13041,
  title  = {EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing},
  author = {Inwoo Hwang and Donggeun Lim and Hojun Jang and Young Min Kim},
  journal= {arXiv preprint arXiv:2605.13041},
  year   = {2026}
}

Comments

Project page: https://inwoohwang.me/EgoForce