English
Related papers

Related papers: Learning Neural Parametric Head Models

200 papers

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Obtaining personalized 3D animatable avatars from a monocular camera has several real world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very challenging to model dynamic and fine-grained clothing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuxuan Xue , Bharat Lal Bhatnagar , Riccardo Marin , Nikolaos Sarafianos , Yuanlu Xu , Gerard Pons-Moll , Tony Tung

A human 3D avatar is one of the important elements in the metaverse, and the modeling effect directly affects people's visual experience. However, the human body has a complex topology and diverse details, so it is often expensive,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Mingyang Sun , Dingkang Yang , Dongliang Kou , Yang Jiang , Weihua Shan , Zhe Yan , Lihua Zhang

Current advances in human head modeling allow the generation of plausible-looking 3D head models via neural representations, such as NeRFs and SDFs. Nevertheless, constructing complete high-fidelity head models with explicitly controlled…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Artem Sevastopolsky , Philip-William Grassal , Simon Giebenhain , ShahRukh Athar , Luisa Verdoliva , Matthias Niessner

This paper presents a novel framework to recover detailed human body shapes from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Hao Zhu , Xinxin Zuo , Sen Wang , Xun Cao , Ruigang Yang

In this paper, we aim to create generalizable and controllable neural signed distance fields (SDFs) that represent clothed humans from monocular depth observations. Recent advances in deep learning, especially neural implicit…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Shaofei Wang , Marko Mihajlovic , Qianli Ma , Andreas Geiger , Siyu Tang

Recent advances in Neural Radiance Fields (NeRF) have demonstrated promising results in 3D scene representations, including 3D human representations. However, these representations often lack crucial information on the underlying human pose…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Arnab Dey , Di Yang , Rohith Agaram , Antitza Dantcheva , Andrew I. Comport , Srinath Sridhar , Jean Martinet

In this paper, we tackle the problem of 3D human shape estimation from single RGB images. While the recent progress in convolutional neural networks has allowed impressive results for 3D human pose estimation, estimating the full 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Valentin Gabeur , Jean-Sebastien Franco , Xavier Martin , Cordelia Schmid , Gregory Rogez

Recovering the 3D geometric structure of a face from a single input image is a challenging active research area in computer vision. In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s)…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Oussema Bouafif , Bogdan Khomutenko , Mohamed Daoudi

We introduce a novel, data-driven approach for reconstructing temporally coherent 3D motion from unstructured and potentially partial observations of non-rigidly deforming shapes. Our goal is to achieve high-fidelity motion reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Aymen Merrouche , Stefanie Wuhrer , Edmond Boyer

We study the problem of reconstructing 3D feature curves of an object from a set of calibrated multi-view images. To do so, we learn a neural implicit field representing the density distribution of 3D edges which we refer to as Neural Edge…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yunfan Ye , Renjiao Yi , Zhirui Gao , Chenyang Zhu , Zhiping Cai , Kai Xu

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto

Human bodies exhibit various shapes for different identities or poses, but the body shape has certain similarities in structure and thus can be embedded in a low-dimensional space. This paper presents an autoencoder-like network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Boyi Jiang , Juyong Zhang , Jianfei Cai , Jianmin Zheng

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

We present deep neural network methodology to reconstruct the 3d pose and shape of people, given an input RGB image. We rely on a recently introduced, expressivefull body statistical 3d human model, GHUM, trained end-to-end, and learn to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Zanfir , William T. Freeman , Rahul Sukthankar , Cristian Sminchisescu

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Precise representations of 3D faces are beneficial to various computer vision and graphics applications. Due to the data discretization and model linearity, however, it remains challenging to capture accurate identity and expression clues…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Mingwu Zheng , Hongyu Yang , Di Huang , Liming Chen

Recovery of a 3D head model including the complete face and hair regions is still a challenging problem in computer vision and graphics. In this paper, we consider this problem using only a few multi-view portrait images as input. Previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xueying Wang , Yudong Guo , Zhongqi Yang , Juyong Zhang

Recent advances in 3D human shape estimation build upon parametric representations that model very well the shape of the naked body, but are not appropriate to represent the clothing geometry. In this paper, we present an approach to model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Albert Pumarola , Jordi Sanchez , Gary P. T. Choi , Alberto Sanfeliu , Francesc Moreno-Noguer

Humans effortlessly infer the 3D shape of objects. What computations underlie this ability? Although various computational models have been proposed, none of them capture the human ability to match object shape across viewpoints. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Thomas P. O'Connell , Tyler Bonnen , Yoni Friedman , Ayush Tewari , Josh B. Tenenbaum , Vincent Sitzmann , Nancy Kanwisher