English

Gaussian Pixel Codec Avatars: A Hybrid Representation for Efficient Rendering

Computer Vision and Pattern Recognition 2025-12-18 v1 Graphics

Abstract

We present Gaussian Pixel Codec Avatars (GPiCA), photorealistic head avatars that can be generated from multi-view images and efficiently rendered on mobile devices. GPiCA utilizes a unique hybrid representation that combines a triangle mesh and anisotropic 3D Gaussians. This combination maximizes memory and rendering efficiency while maintaining a photorealistic appearance. The triangle mesh is highly efficient in representing surface areas like facial skin, while the 3D Gaussians effectively handle non-surface areas such as hair and beard. To this end, we develop a unified differentiable rendering pipeline that treats the mesh as a semi-transparent layer within the volumetric rendering paradigm of 3D Gaussian Splatting. We train neural networks to decode a facial expression code into three components: a 3D face mesh, an RGBA texture, and a set of 3D Gaussians. These components are rendered simultaneously in a unified rendering engine. The networks are trained using multi-view image supervision. Our results demonstrate that GPiCA achieves the realism of purely Gaussian-based avatars while matching the rendering performance of mesh-based avatars.

Keywords

Cite

@article{arxiv.2512.15711,
  title  = {Gaussian Pixel Codec Avatars: A Hybrid Representation for Efficient Rendering},
  author = {Divam Gupta and Anuj Pahuja and Nemanja Bartolovic and Tomas Simon and Forrest Iandola and Giljoo Nam},
  journal= {arXiv preprint arXiv:2512.15711},
  year   = {2025}
}

Comments

Tech report

R2 v1 2026-07-01T08:29:42.348Z