English
Related papers

Related papers: Beyond 3DMM: Learning to Capture High-fidelity 3D …

200 papers

3D Morphable Models (3DMMs) demonstrate great potential for reconstructing faithful and animatable 3D facial surfaces from a single image. The facial surface is influenced by the coarse shape, as well as the static detail (e,g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zenghao Chai , Tianke Zhang , Tianyu He , Xu Tan , Tadas Baltrušaitis , HsiangTao Wu , Runnan Li , Sheng Zhao , Chun Yuan , Jiang Bian

3D Morphable Models (3DMMs) enable controllable facial geometry and expression editing for reconstruction, animation, and AR/VR, but traditional PCA-based mesh models are limited in resolution, detail, and photorealism. Neural volumetric…

3D Morphable Models (3DMMs) are generative models for face shape and appearance. However, the shape parameters of traditional 3DMMs satisfy the multivariate Gaussian distribution while the identity embeddings satisfy the hypersphere…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Diqiong Jiang , Yiwei Jin , Fanglue Zhang , Zhe Zhu , Yun Zhang , Ruofeng Tong , Min Tang

In this paper, we introduce the Volumetric Relightable Morphable Model (VRMM), a novel volumetric and parametric facial prior for 3D face modeling. While recent volumetric prior models offer improvements over traditional methods like 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Haotian Yang , Mingwu Zheng , Chongyang Ma , Yu-Kun Lai , Pengfei Wan , Haibin Huang

This work focuses on complete 3D facial geometry prediction, including 3D facial alignment via 3D face modeling and face orientation estimation using the proposed multi-task, multi-modal, and multi-representation landmark refinement network…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Cho-Ying Wu , Qiangeng Xu , Ulrich Neumann

Facial alignment involves finding a set of landmark points on an image with a known semantic meaning. However, this semantic meaning of landmark points is often lost in 2D approaches where landmarks are either moved to visible boundaries or…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Chandrasekhar Bhagavatula , Chenchen Zhu , Khoa Luu , Marios Savvides

We propose a novel technique for producing high-quality 3D models that match a given target object image or scan. Our method is based on retrieving an existing shape from a database of 3D models and then deforming its parts to match the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mikaela Angelina Uy , Vladimir G. Kim , Minhyuk Sung , Noam Aigerman , Siddhartha Chaudhuri , Leonidas Guibas

We address the problem of estimating the shape of a person's head, defined as the geometry of the complete head surface, from a video taken with a single moving camera, and determining the alignment of the fitted 3D head for all video…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Tejas Mane , Aylar Bayramova , Kostas Daniilidis , Philippos Mordohai , Elena Bernardis

Recovering 3D object pose and shape from a single image is a challenging and ill-posed problem. This is due to strong (self-)occlusions, depth ambiguities, the vast intra- and inter-class shape variance, and the lack of 3D ground truth for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Dimitrije Antić , Georgios Paschalidis , Shashank Tripathi , Theo Gevers , Sai Kumar Dwivedi , Dimitrios Tzionas

This paper proposes a novel model fitting algorithm for 3D facial expression reconstruction from a single image. Face expression reconstruction from a single image is a challenging task in computer vision. Most state-of-the-art methods fit…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Fanzi Wu , Songnan Li , Tianhao Zhao , King Ngi Ngan , Lv Sheng

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

In this study, we address the challenge of 3D scene structure recovery from monocular depth estimation. While traditional depth estimation methods leverage labeled datasets to directly predict absolute depth, recent advancements advocate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chi Zhang , Wei Yin , Gang Yu , Zhibin Wang , Tao Chen , Bin Fu , Joey Tianyi Zhou , Chunhua Shen

Reconstructing high-fidelity 3D head geometry from images is critical for a wide range of applications, yet existing methods face fundamental limitations. Traditional photogrammetry achieves exceptional detail but requires extensive camera…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Noé Artru , Rukhshanda Hussain , Emeline Got , Alexandre Messier , David B. Lindell , Abdallah Dib

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

Three-dimensional Morphable Models (3DMMs) are powerful statistical tools for representing the 3D shapes and textures of an object class. Here we present the most complete 3DMM of the human head to date that includes face, cranium, ears,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Stylianos Ploumpis , Evangelos Ververas , Eimear O' Sullivan , Stylianos Moschoglou , Haoyang Wang , Nick Pears , William A. P. Smith , Baris Gecer , Stefanos Zafeiriou

We propose a scalable neural network framework to reconstruct the 3D mesh of a human body from multi-view images, in the subspace of the SMPL model. Use of multi-view images can significantly reduce the projection ambiguity of the problem,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Junbang Liang , Ming C. Lin

An efficient, fully automatic method for 3D face shape and pose estimation in unconstrained 2D imagery is presented. The proposed method jointly estimates a dense set of 3D landmarks and facial geometry using a single pass of a modified…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Daniel Crispell , Maxim Bazik

We present the first deep implicit 3D morphable model (i3DMM) of full heads. Unlike earlier morphable face models it not only captures identity-specific geometry, texture, and expressions of the frontal face, but also models the entire…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Tarun Yenamandra , Ayush Tewari , Florian Bernard , Hans-Peter Seidel , Mohamed Elgharib , Daniel Cremers , Christian Theobalt

Parametric 3D models have enabled a wide variety of computer vision and graphics tasks, such as modeling human faces, bodies and hands. In 3D face modeling, 3DMM is the most widely used parametric model, but can't generate fine geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Haitao Cao , Baoping Cheng , Qiran Pu , Haocheng Zhang , Bin Luo , Yixiang Zhuang , Juncong Lin , Liyan Chen , Xuan Cheng

This paper presents a novel framework to recover detailed human body shapes from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Hao Zhu , Xinxin Zuo , Sen Wang , Xun Cao , Ruigang Yang