English
Related papers

Related papers: 3D Facial Expression Reconstruction using Cascaded…

200 papers

Existing single view, 3D face reconstruction methods can produce beautifully detailed 3D results, but typically only for near frontal, unobstructed viewpoints. We describe a system designed to provide detailed 3D reconstructions of faces…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Anh Tuan Tran , Tal Hassner , Iacopo Masi , Eran Paz , Yuval Nirkin , Gerard Medioni

Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS),…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Raja Kumar , Jiahao Luo , Alex Pang , James Davis

In this paper, we propose a novel fitting method that uses local image features to fit a 3D Morphable Model to 2D images. To overcome the obstacle of optimising a cost function that contains a non-differentiable feature extraction operator,…

Computer Vision and Pattern Recognition · Computer Science 2016-05-13 Patrik Huber , Zhen-Hua Feng , William Christmas , Josef Kittler , Matthias Rätsch

In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded in a nonlinear way.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Zi-Hang Jiang , Qianyi Wu , Keyu Chen , Juyong Zhang

We present a self-supervised learning approach to learning monocular 3D face reconstruction with a pose guidance network (PGN). First, we unveil the bottleneck of pose estimation in prior parametric 3D face learning methods, and propose to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Pengpeng Liu , Xintong Han , Michael Lyu , Irwin King , Jia Xu

There are increasing real-time live applications in virtual reality, where it plays an important role in capturing and retargetting 3D human pose. But it is still challenging to estimate accurate 3D pose from consumer imaging devices such…

Graphics · Computer Science 2018-01-26 Shihong Xia , Zihao Zhang , Le Su

We investigate the problem of estimating the 3D shape of an object, given a set of 2D landmarks in a single image. To alleviate the reconstruction ambiguity, a widely-used approach is to confine the unknown 3D shape within a shape space…

Computer Vision and Pattern Recognition · Computer Science 2015-06-03 Xiaowei Zhou , Spyridon Leonardos , Xiaoyan Hu , Kostas Daniilidis

This work studies learning from a synergy process of 3D Morphable Models (3DMM) and 3D facial landmarks to predict complete 3D facial geometry, including 3D alignment, face orientation, and 3D face modeling. Our synergy process leverages a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Cho-Ying Wu , Qiangeng Xu , Ulrich Neumann

Recently, deep learning-based 3D face reconstruction methods have demonstrated promising advancements in terms of quality and efficiency. Nevertheless, these techniques face challenges in effectively handling occluded scenes and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dapeng Zhao

We address the problem of estimating the shape of a person's head, defined as the geometry of the complete head surface, from a video taken with a single moving camera, and determining the alignment of the fitted 3D head for all video…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Tejas Mane , Aylar Bayramova , Kostas Daniilidis , Philippos Mordohai , Elena Bernardis

We propose a method to build in real-time animated 3D head models using a consumer-grade RGB-D camera. Our proposed method is the first one to provide simultaneously comprehensive facial motion tracking and a detailed 3D model of the user's…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Diego Thomas

Performing facial expression transfer under one-shot setting has been increasing in popularity among research community with a focus on precise control of expressions. Existing techniques showcase compelling results in perceiving…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Siddharth Nijhawan , Takuya Yashima , Tamaki Kojima

Recovering the 3D geometric structure of a face from a single input image is a challenging active research area in computer vision. In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s)…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Oussema Bouafif , Bogdan Khomutenko , Mohamed Daoudi

Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Mallikarjun B R , Ayush Tewari , Hans-Peter Seidel , Mohamed Elgharib , Christian Theobalt

This paper describes our submission to the 1st 3D Face Alignment in the Wild (3DFAW) Challenge. Our method builds upon the idea of convolutional part heatmap regression [1], extending it for 3D face alignment. Our method decomposes the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Adrian Bulat , Georgios Tzimiropoulos

3D Morphable Models (3DMMs) demonstrate great potential for reconstructing faithful and animatable 3D facial surfaces from a single image. The facial surface is influenced by the coarse shape, as well as the static detail (e,g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zenghao Chai , Tianke Zhang , Tianyu He , Xu Tan , Tadas Baltrušaitis , HsiangTao Wu , Runnan Li , Sheng Zhao , Chun Yuan , Jiang Bian

Reconstructing 3D face models from a single image is an inherently ill-posed problem, which becomes even more challenging in the presence of occlusions. In addition to fewer available observations, occlusions introduce an extra source of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Pratheba Selvaraju , Victoria Fernandez Abrevaya , Timo Bolkart , Rick Akkerman , Tianyu Ding , Faezeh Amjadi , Ilya Zharkov

3D Morphable Models (3DMMs) enable controllable facial geometry and expression editing for reconstruction, animation, and AR/VR, but traditional PCA-based mesh models are limited in resolution, detail, and photorealism. Neural volumetric…

3D face reconstruction from a single 2D image is a very important topic in computer vision. However, the current reconstruction methods are usually non-sensitive to face identities and over-sensitive to facial poses, which may result in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Yao Luo , Xiaoguang Tu , Mei Xie

Landmarks often play a key role in face analysis, but many aspects of identity or expression cannot be represented by sparse landmarks alone. Thus, in order to reconstruct faces more accurately, landmarks are often combined with additional…