English

Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors

Computer Vision and Pattern Recognition 2025-08-14 v1

Abstract

We revisit the role of texture in monocular 3D hand reconstruction, not as an afterthought for photorealism, but as a dense, spatially grounded cue that can actively support pose and shape estimation. Our observation is simple: even in high-performing models, the overlay between predicted hand geometry and image appearance is often imperfect, suggesting that texture alignment may be an underused supervisory signal. We propose a lightweight texture module that embeds per-pixel observations into UV texture space and enables a novel dense alignment loss between predicted and observed hand appearances. Our approach assumes access to a differentiable rendering pipeline and a model that maps images to 3D hand meshes with known topology, allowing us to back-project a textured hand onto the image and perform pixel-based alignment. The module is self-contained and easily pluggable into existing reconstruction pipelines. To isolate and highlight the value of texture-guided supervision, we augment HaMeR, a high-performing yet unadorned transformer architecture for 3D hand pose estimation. The resulting system improves both accuracy and realism, demonstrating the value of appearance-guided alignment in hand reconstruction.

Keywords

Cite

@article{arxiv.2508.09629,
  title  = {Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors},
  author = {Giorgos Karvounas and Nikolaos Kyriazis and Iason Oikonomidis and Georgios Pavlakos and Antonis A. Argyros},
  journal= {arXiv preprint arXiv:2508.09629},
  year   = {2025}
}
R2 v1 2026-07-01T04:47:48.306Z