English
Related papers

Related papers: 3D Human Face Reconstruction with 3DMM face model …

200 papers

As a classic statistical model of 3D facial shape and texture, 3D Morphable Model (3DMM) is widely used in facial analysis, e.g., model fitting, image synthesis. Conventional 3DMM is learned from a set of well-controlled 2D face images with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Luan Tran , Xiaoming Liu

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

Deep learning approaches have achieved highly accurate face recognition by training the models with very large face image datasets. Unlike the availability of large 2D face image datasets, there is a lack of large 3D face datasets available…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Meng-Tzu Chiu , Hsun-Ying Cheng , Chien-Yi Wang , Shang-Hong Lai

Reconstructing high-fidelity 3D facial texture from a single image is a quite challenging task due to the lack of complete face information and the domain gap between the 3D face and 2D image. Further, obtaining re-renderable 3D faces has…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Mingxin Yang , Jianwei Guo , Zhanglin Cheng , Xiaopeng Zhang , Dong-Ming Yan

We present Monocular Neural Parametric Head Models (MonoNPHM) for dynamic 3D head reconstructions from monocular RGB videos. To this end, we propose a latent appearance space that parameterizes a texture field on top of a neural parametric…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simon Giebenhain , Tobias Kirschstein , Markos Georgopoulos , Martin Rünz , Lourdes Agapito , Matthias Nießner

We propose a novel 3D face recognition algorithm using a deep convolutional neural network (DCNN) and a 3D augmentation technique. The performance of 2D face recognition algorithms has significantly increased by leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Donghyun Kim , Matthias Hernandez , Jongmoo Choi , Gerard Medioni

Face recognition has been of great importance in many applications as a biometric for its throughput, convenience, and non-invasiveness. Recent advancements in deep Convolutional Neural Network (CNN) architectures have boosted significantly…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Zhiqian You , Tingting Yang , Miao Jin

3D face reconstruction plays a very important role in many real-world multimedia applications, including digital entertainment, social media, affection analysis, and person identification. The de-facto pipeline for estimating the parametric…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Jialiang Zhang , Lixiang Lin , Jianke Zhu , Steven C. H. Hoi

We study how to synthesize novel views of human body from a single image. Though recent deep learning based methods work well for rigid objects, they often fail on objects with large articulation, like human bodies. The core step of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Hao Zhu , Hao Su , Peng Wang , Xun Cao , Ruigang Yang

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses. This is because the uncertainty of the estimated 2D landmarks will affect the quality of face reconstruction. In…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Kun Li , Jing Yang , Nianhong Jiao , Jinsong Zhang , Yu-Kun Lai

We present a minimalistic but effective neural network that computes dense facial correspondences in highly unconstrained RGB images. Our network learns a per-pixel flow and a matchability mask between 2D input photographs of a person and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Ronald Yu , Shunsuke Saito , Haoxiang Li , Duygu Ceylan , Hao Li

This work addresses a novel and challenging problem of estimating the full 3D hand shape and pose from a single RGB image. Most current methods in 3D hand analysis from monocular RGB images only focus on estimating the 3D locations of hand…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang , Jianfei Cai , Junsong Yuan

High-fidelity reconstruction of head avatars from monocular videos is highly desirable for virtual human applications, but it remains a challenge in the fields of computer graphics and computer vision. In this paper, we propose a two-phase…

Graphics · Computer Science 2025-03-31 Pilseo Park , Ze Zhang , Michel Sarkis , Ning Bi , Xiaoming Liu , Yiying Tong

Many deep learning based 3D face reconstruction methods have been proposed recently, however, few of them have applications in games. Current game character customization systems either require players to manually adjust considerable face…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Jiangke Lin , Yi Yuan , Zhengxia Zou

In this work we propose a novel model-based deep convolutional autoencoder that addresses the highly challenging problem of reconstructing a 3D human face from a single in-the-wild color image. To this end, we combine a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Ayush Tewari , Michael Zollhöfer , Hyeongwoo Kim , Pablo Garrido , Florian Bernard , Patrick Pérez , Christian Theobalt

This paper presents a neural network to estimate a detailed depth map of the foreground human in a single RGB image. The result captures geometry details such as cloth wrinkles, which are important in visualization applications. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Sicong Tang , Feitong Tan , Kelvin Cheng , Zhaoyang Li , Siyu Zhu , Ping Tan

We present a learning-based model to infer the personalized 3D shape of people from a few frames (1-8) of a monocular video in which the person is moving, in less than 10 seconds with a reconstruction accuracy of 5mm. Our model learns to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Thiemo Alldieck , Marcus Magnor , Bharat Lal Bhatnagar , Christian Theobalt , Gerard Pons-Moll

Face recognition is a widely accepted biometric verification tool, as the face contains a lot of information about the identity of a person. In this study, a 2-step neural-based pipeline is presented for matching 3D facial shape to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Soha Sadat Mahdi , Nele Nauwelaers , Philip Joris , Giorgos Bouritsas , Shunwang Gong , Sergiy Bokhnyak , Susan Walsh , Mark D. Shriver , Michael Bronstein , Peter Claes , .

We propose a method to build in real-time animated 3D head models using a consumer-grade RGB-D camera. Our proposed method is the first one to provide simultaneously comprehensive facial motion tracking and a detailed 3D model of the user's…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Diego Thomas

Reconstructing the 3D mesh of a general object from a single image is now possible thanks to the latest advances of deep learning technologies. However, due to the nontrivial difficulty of generating a feasible mesh structure, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Junyi Pan , Xiaoguang Han , Weikai Chen , Jiapeng Tang , Kui Jia