English

Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures

Computer Vision and Pattern Recognition 2026-05-11 v2 Machine Learning

Abstract

We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a compact latent representation. This latent representation is then decoded into a set of UV-parameterized 3D Gaussians anchored to a neutral head template. This UV representation decouples the number of 3D Gaussians from the number and resolution of input images, enabling training with many high-resolution input views. We train and evaluate our model on an internal dataset with more than 10,000 subjects, which is an order of magnitude larger than existing multi-view human head datasets. HeadsUp achieves state-of-the-art reconstruction quality and generalizes to novel identities without test-time optimization. We extensively analyze the scaling behavior of our model across identities, views, and model capacity, revealing practical insights for quality-compute trade-offs. Finally, we highlight the strength of our latent space by showcasing two downstream applications: generating novel 3D identities and animating the 3D heads with expression blendshapes.

Keywords

Cite

@article{arxiv.2605.04035,
  title  = {Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures},
  author = {Evangelos Ntavelis and Sean Wu and Mohamad Shahbazi and Fabio Maninchedda and Dmitry Kostiaev and Artem Sevastopolsky and Vittorio Megaro and Trevor Phillips and Alejandro Blumentals and Shridhar Ravikumar and Mehak Gupta and Reinhard Knothe and Jeronimo Bayer and Matthias Vestner and Simon Schaefer and Thomas Etterlin and Christian Zimmermann and Mathias Deschler and Peter Kaufmann and Stefan Brugger and Sebastian Martin and Brian Amberg and Tom Runia},
  journal= {arXiv preprint arXiv:2605.04035},
  year   = {2026}
}

Comments

Project page: https://apple.github.io/ml-headsup/

R2 v1 2026-07-01T12:51:21.134Z