Recent advances in full-head reconstruction have been obtained by optimizing a neural field through differentiable surface or volume rendering to represent a single scene. While these techniques achieve an unprecedented accuracy, they take several minutes, or even hours, due to the expensive optimization process required. In this work, we introduce InstantAvatar, a method that recovers full-head avatars from few images (down to just one) in a few seconds on commodity hardware. In order to speed up the reconstruction process, we propose a system that combines, for the first time, a voxel-grid neural field representation with a surface renderer. Notably, a naive combination of these two techniques leads to unstable optimizations that do not converge to valid solutions. In order to overcome this limitation, we present a novel statistical model that learns a prior distribution over 3D head signed distance functions using a voxel-grid based architecture. The use of this prior model, in combination with other design choices, results into a system that achieves 3D head reconstructions with comparable accuracy as the state-of-the-art with a 100x speed-up.
@article{arxiv.2308.04868,
title = {InstantAvatar: Efficient 3D Head Reconstruction via Surface Rendering},
author = {Antonio Canela and Pol Caselles and Ibrar Malik and Eduard Ramon and Jaime García and Jordi Sánchez-Riera and Gil Triginer and Francesc Moreno-Noguer},
journal= {arXiv preprint arXiv:2308.04868},
year = {2024}
}