English

D-PoSE: Depth as an Intermediate Representation for 3D Human Pose and Shape Estimation

Computer Vision and Pattern Recognition 2024-10-08 v1

Abstract

We present D-PoSE (Depth as an Intermediate Representation for 3D Human Pose and Shape Estimation), a one-stage method that estimates human pose and SMPL-X shape parameters from a single RGB image. Recent works use larger models with transformer backbones and decoders to improve the accuracy in human pose and shape (HPS) benchmarks. D-PoSE proposes a vision based approach that uses the estimated human depth-maps as an intermediate representation for HPS and leverages training with synthetic data and the ground-truth depth-maps provided with them for depth supervision during training. Although trained on synthetic datasets, D-PoSE achieves state-of-the-art performance on the real-world benchmark datasets, EMDB and 3DPW. Despite its simple lightweight design and the CNN backbone, it outperforms ViT-based models that have a number of parameters that is larger by almost an order of magnitude. D-PoSE code is available at: https://github.com/nvasilik/D-PoSE

Keywords

Cite

@article{arxiv.2410.04889,
  title  = {D-PoSE: Depth as an Intermediate Representation for 3D Human Pose and Shape Estimation},
  author = {Nikolaos Vasilikopoulos and Drosakis Drosakis and Antonis Argyros},
  journal= {arXiv preprint arXiv:2410.04889},
  year   = {2024}
}
R2 v1 2026-06-28T19:10:55.165Z