English

Egocentric Whole-Body Human Mesh Recovery with Prior-Guided Learning

Computer Vision and Pattern Recognition 2026-05-12 v1

Abstract

Egocentric human mesh recovery (HMR) from monocular head-mounted cameras is increasingly important for AR/VR applications, but remains challenging due to the lack of reliable ground-truth (GT) annotations based on parametric human body models such as SMPL and SMPL-X for real egocentric images. Existing egocentric HMR methods typically rely on pseudo-GT and focus on body pose estimation, which limits their ability to recover fine-grained whole-body details such as hands and face. We study egocentric whole-body human mesh recovery and propose a prior-guided learning framework that reconstructs whole-body meshes from a single egocentric image. We construct more accurate optimization-based pseudo-GT aligned with 3D joint supervision, and leverage multiple priors by adapting an exocentric HMR foundation model together with a diffusion-based pose prior. A deterministic undistortion module is further adopted to handle fisheye distortions in egocentric images. Experiments across multiple egocentric benchmarks demonstrate improved whole-body reconstruction compared to state-of-the-art methods, and show that our optimization-based pseudo-GT is substantially more accurate than existing regression-based pseudo-GT. To facilitate reproducibility, the code and dataset annotations are publicly available at https://github.com/naso06/EgoSMPLX.

Keywords

Cite

@article{arxiv.2605.08606,
  title  = {Egocentric Whole-Body Human Mesh Recovery with Prior-Guided Learning},
  author = {Soyeon Na and Seung Young Noh and Ju Yong Chang},
  journal= {arXiv preprint arXiv:2605.08606},
  year   = {2026}
}

Comments

Accepted to ICIP 2026. This is the author-formatted version of the paper