Human bodies exhibit various shapes for different identities or poses, but the body shape has certain similarities in structure and thus can be embedded in a low-dimensional space. This paper presents an autoencoder-like network architecture to learn disentangled shape and pose embedding specifically for the 3D human body. This is inspired by recent progress of deformation-based latent representation learning. To improve the reconstruction accuracy, we propose a hierarchical reconstruction pipeline for the disentangling process and construct a large dataset of human body models with consistent connectivity for the learning of the neural network. Our learned embedding can not only achieve superior reconstruction accuracy but also provide great flexibility in 3D human body generation via interpolation, bilinear interpolation, and latent space sampling. The results from extensive experiments demonstrate the powerfulness of our learned 3D human body embedding in various applications.
@article{arxiv.1905.05622,
title = {Disentangled Human Body Embedding Based on Deep Hierarchical Neural Network},
author = {Boyi Jiang and Juyong Zhang and Jianfei Cai and Jianmin Zheng},
journal= {arXiv preprint arXiv:1905.05622},
year = {2020}
}
Comments
This manuscript is accepted for publication in the IEEE Transactions on Visualization and Computer Graphics Journal (IEEE TVCG). The Code is available at https://github.com/Juyong/DHNN_BodyRepresentation