English
Related papers

Related papers: Nonlinear 3D Face Morphable Model

200 papers

Morphable Models (3DMMs) are a type of morphable model that takes 2D images as inputs and recreates the structure and physical appearance of 3D objects, especially human faces and bodies. 3DMM combines identity and expression blendshapes…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Gulraiz Khan , Kenneth Y. Wertheim , Kevin Pimbblet , Waqas Ahmed

Facial motion retargeting is an important problem in both computer graphics and vision, which involves capturing the performance of a human face and transferring it to another 3D character. Learning 3D morphable model (3DMM) parameters from…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Bindita Chaudhuri , Noranart Vesdapunt , Baoyuan Wang

Many methods have been proposed over the years to tackle the task of facial 3D geometry and texture recovery from a single image. Such methods often fail to provide high-fidelity texture without relying on 3D facial scans during training.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Ron Slossberg , Ibrahim Jubran , Ron Kimmel

Face recognition is a widely accepted biometric verification tool, as the face contains a lot of information about the identity of a person. In this study, a 2-step neural-based pipeline is presented for matching 3D facial shape to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Soha Sadat Mahdi , Nele Nauwelaers , Philip Joris , Giorgos Bouritsas , Shunwang Gong , Sergiy Bokhnyak , Susan Walsh , Mark D. Shriver , Michael Bronstein , Peter Claes , .

Reconstructing 3D face from a single unconstrained image remains a challenging problem due to diverse conditions in unconstrained environments. Recently, learning-based methods have achieved notable results by effectively capturing complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Danling Cao

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

This paper proposes a novel model fitting algorithm for 3D facial expression reconstruction from a single image. Face expression reconstruction from a single image is a challenging task in computer vision. Most state-of-the-art methods fit…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Fanzi Wu , Songnan Li , Tianhao Zhao , King Ngi Ngan , Lv Sheng

Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS),…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Raja Kumar , Jiahao Luo , Alex Pang , James Davis

The research fields of parametric face model and 3D face reconstruction have been extensively studied. However, a critical question remains unanswered: how to tailor the face model for specific reconstruction settings. We argue that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Kai Yang , Hong Shang , Tianyang Shi , Xinghan Chen , Jingkai Zhou , Zhongqian Sun , Wei Yang

While impressive progress has recently been made in image-oriented facial attribute translation, shape-oriented 3D facial attribute translation remains an unsolved issue. This is primarily limited by the lack of 3D generative models and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Zhenfeng Fan , Zhiheng Zhang , Shuang Yang , Chongyang Zhong , Min Cao , Shihong Xia

Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable models mostly focus on large-scale facial geometry but ignore facial details. This paper augments morphable models in representing facial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Jingwang Ling , Zhibo Wang , Ming Lu , Quan Wang , Chen Qian , Feng Xu

In this paper, we provide a detailed survey of 3D Morphable Face Models over the 20 years since they were first proposed. The challenges in building and applying these models, namely capture, modeling, image formation, and image analysis,…

3D face reconstruction and face alignment are two fundamental and highly related topics in computer vision. Recently, some works start to use deep learning models to estimate the 3DMM coefficients to reconstruct 3D face geometry. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zihao Jian , Minshan Xie

We present the first 3D morphable modelling approach, whereby 3D face shape can be directly and completely defined using a textual prompt. Building on work in multi-modal learning, we extend the FLAME head model to a common image-and-text…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Will Rowan , Patrik Huber , Nick Pears , Andrew Keeling

Monocular image-based 3D reconstruction of faces is a long-standing problem in computer vision. Since image data is a 2D projection of a 3D face, the resulting depth ambiguity makes the problem ill-posed. Most existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ayush Tewari , Florian Bernard , Pablo Garrido , Gaurav Bharaj , Mohamed Elgharib , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

3D face reconstruction plays a very important role in many real-world multimedia applications, including digital entertainment, social media, affection analysis, and person identification. The de-facto pipeline for estimating the parametric…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Jialiang Zhang , Lixiang Lin , Jianke Zhu , Steven C. H. Hoi

We present a statistical model for $3$D human faces in varying expression, which decomposes the surface of the face using a wavelet transform, and learns many localized, decorrelated multilinear models on the resulting coefficients. Using…

Computer Vision and Pattern Recognition · Computer Science 2014-07-02 Alan Brunton , Timo Bolkart , Stefanie Wuhrer

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

In this work we propose a novel model-based deep convolutional autoencoder that addresses the highly challenging problem of reconstructing a 3D human face from a single in-the-wild color image. To this end, we combine a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Ayush Tewari , Michael Zollhöfer , Hyeongwoo Kim , Pablo Garrido , Florian Bernard , Patrick Pérez , Christian Theobalt