English
Related papers

Related papers: Learning Neural Parametric Head Models

200 papers

Recovering the geometry of a human head from a single image, while factorizing the materials and illumination is a severely ill-posed problem that requires prior information to be solved. Methods based on 3D Morphable Models (3DMM), and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Pol Caselles , Eduard Ramon , Jaime Garcia , Xavier Giro-i-Nieto , Francesc Moreno-Noguer , Gil Triginer

We present DAD-3DHeads, a dense and diverse large-scale dataset, and a robust model for 3D Dense Head Alignment in the wild. It contains annotations of over 3.5K landmarks that accurately represent 3D head shape compared to the ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Tetiana Martyniuk , Orest Kupyn , Yana Kurliak , Igor Krashenyi , Jiři Matas , Viktoriia Sharmanska

High-fidelity reconstruction of 3D human avatars has a wild application in visual reality. In this paper, we introduce FAGhead, a method that enables fully controllable human portraits from monocular videos. We explicit the traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Yixin Xuan , Xinyang Li , Gongxin Yao , Shiwei Zhou , Donghui Sun , Xiaoxin Chen , Yu Pan

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed traditional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Ali Youssef , Francisco Vasconcelos

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

We address the problem of clothed human reconstruction from a single image or uncalibrated multi-view images. Existing methods struggle with reconstructing detailed geometry of a clothed human and often require a calibrated setting for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yukang Cao , Kai Han , Kwan-Yee K. Wong

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Christina Tsalicoglou , Keisuke Tateno , Jonathan T. Barron , Federico Tombari

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Jianhui Li , Shilong Liu , Zidong Liu , Yikai Wang , Kaiwen Zheng , Jinghui Xu , Jianmin Li , Jun Zhu

Animatable 3D human reconstruction from a single image is a challenging problem due to the ambiguity in decoupling geometry, appearance, and deformation. Recent advances in 3D human reconstruction mainly focus on static human modeling, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Lingteng Qiu , Xiaodong Gu , Peihao Li , Qi Zuo , Weichao Shen , Junfei Zhang , Kejie Qiu , Weihao Yuan , Guanying Chen , Zilong Dong , Liefeng Bo

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Recently proposed robust 3D face alignment methods establish either dense or sparse correspondence between a 3D face model and a 2D facial image. The use of these methods presents new challenges as well as opportunities for facial texture…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Jiankang Deng , Shiyang Cheng , Niannan Xue , Yuxiang Zhou , Stefanos Zafeiriou

The reconstruction of dense 3D models of face geometry and appearance from a single image is highly challenging and ill-posed. To constrain the problem, many approaches rely on strong priors, such as parametric face models learned from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Ayush Tewari , Michael Zollhöfer , Pablo Garrido , Florian Bernard , Hyeongwoo Kim , Patrick Pérez , Christian Theobalt

This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Some recent approaches to this task predict probability distributions over human body model parameters conditioned on the input images. This is…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Akash Sengupta , Ignas Budvytis , Roberto Cipolla

In this work, we present an automated workflow to bring human figures, one of the most frequently appearing entities on pictorial maps, to the third dimension. Our workflow is based on training data and neural networks for single-view 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Raimund Schnürer , A. Cengiz Öztireli , Magnus Heitzler , René Sieber , Lorenz Hurni

Neural fields have revolutionized the area of 3D reconstruction and novel view synthesis of rigid scenes. A key challenge in making such methods applicable to articulated objects, such as the human body, is to model the deformation of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Xu Chen , Tianjian Jiang , Jie Song , Max Rietmann , Andreas Geiger , Michael J. Black , Otmar Hilliges

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

Deep neural networks (DNNs) trained on large-scale datasets have recently achieved impressive improvements in face recognition. But a persistent challenge remains to develop methods capable of handling large pose variations that are…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Xi Peng , Xiang Yu , Kihyuk Sohn , Dimitris Metaxas , Manmohan Chandraker

We present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Zhang Chen , Zhong Li , Liangchen Song , Lele Chen , Jingyi Yu , Junsong Yuan , Yi Xu