English

HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors

Computer Vision and Pattern Recognition 2025-01-14 v2

Abstract

In this paper, we present a novel 3D head avatar creation approach capable of generalizing from few-shot in-the-wild data with high-fidelity and animatable robustness. Given the underconstrained nature of this problem, incorporating prior knowledge is essential. Therefore, we propose a framework comprising prior learning and avatar creation phases. The prior learning phase leverages 3D head priors derived from a large-scale multi-view dynamic dataset, and the avatar creation phase applies these priors for few-shot personalization. Our approach effectively captures these priors by utilizing a Gaussian Splatting-based auto-decoder network with part-based dynamic modeling. Our method employs identity-shared encoding with personalized latent codes for individual identities to learn the attributes of Gaussian primitives. During the avatar creation phase, we achieve fast head avatar personalization by leveraging inversion and fine-tuning strategies. Extensive experiments demonstrate that our model effectively exploits head priors and successfully generalizes them to few-shot personalization, achieving photo-realistic rendering quality, multi-view consistency, and stable animation.

Keywords

Cite

@article{arxiv.2408.06019,
  title  = {HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors},
  author = {Xiaozheng Zheng and Chao Wen and Zhaohu Li and Weiyi Zhang and Zhuo Su and Xu Chang and Yang Zhao and Zheng Lv and Xiaoyuan Zhang and Yongjie Zhang and Guidong Wang and Lan Xu},
  journal= {arXiv preprint arXiv:2408.06019},
  year   = {2025}
}

Comments

Accepted to 3DV 2025. Project page: https://headgap.github.io/