English
Related papers

Related papers: Dense 3D Face Decoding over 2500FPS: Joint Texture…

200 papers

3D Morphable Models (3DMMs) demonstrate great potential for reconstructing faithful and animatable 3D facial surfaces from a single image. The facial surface is influenced by the coarse shape, as well as the static detail (e,g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zenghao Chai , Tianke Zhang , Tianyu He , Xu Tan , Tadas Baltrušaitis , HsiangTao Wu , Runnan Li , Sheng Zhao , Chun Yuan , Jiang Bian

Recent advances in 3D face stylization have made significant strides in few to zero-shot settings. However, the degree of stylization achieved by existing methods is often not sufficient for practical applications because they are mostly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Soyeon Yoon , Kwan Yun , Kwanggyoon Seo , Sihun Cha , Jung Eun Yoo , Junyong Noh

We propose a deep learning approach for finding dense correspondences between 3D scans of people. Our method requires only partial geometric information in the form of two depth maps or partial reconstructed surfaces, works for humans in…

Computer Vision and Pattern Recognition · Computer Science 2016-06-28 Lingyu Wei , Qixing Huang , Duygu Ceylan , Etienne Vouga , Hao Li

Learning latent representations of registered meshes is useful for many 3D tasks. Techniques have recently shifted to neural mesh autoencoders. Although they demonstrate higher precision than traditional methods, they remain unable to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Yi Zhou , Chenglei Wu , Zimo Li , Chen Cao , Yuting Ye , Jason Saragih , Hao Li , Yaser Sheikh

We propose a straightforward method that simultaneously reconstructs the 3D facial structure and provides dense alignment. To achieve this, we design a 2D representation called UV position map which records the 3D shape of a complete face…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Yao Feng , Fan Wu , Xiaohu Shao , Yanfeng Wang , Xi Zhou

We present a statistical model for $3$D human faces in varying expression, which decomposes the surface of the face using a wavelet transform, and learns many localized, decorrelated multilinear models on the resulting coefficients. Using…

Computer Vision and Pattern Recognition · Computer Science 2014-07-02 Alan Brunton , Timo Bolkart , Stefanie Wuhrer

With the rising popularity of virtual worlds, the importance of data-driven parametric models of 3D meshes has grown rapidly. Numerous applications, such as computer vision, procedural generation, and mesh editing, vastly rely on these…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Robert Kosk , Richard Southern , Lihua You , Shaojun Bian , Willem Kokke , Greg Maguire

In this paper, we introduce the Volumetric Relightable Morphable Model (VRMM), a novel volumetric and parametric facial prior for 3D face modeling. While recent volumetric prior models offer improvements over traditional methods like 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Haotian Yang , Mingwu Zheng , Chongyang Ma , Yu-Kun Lai , Pengfei Wan , Haibin Huang

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

Diffusion probabilistic models (DPMs) have achieved remarkable quality in image generation that rivals GANs'. But unlike GANs, DPMs use a set of latent variables that lack semantic meaning and cannot serve as a useful representation for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Konpat Preechakul , Nattanat Chatthee , Suttisak Wizadwongsa , Supasorn Suwajanakorn

We propose 3Deformer, a general-purpose framework for interactive 3D shape editing. Given a source 3D mesh with semantic materials, and a user-specified semantic image, 3Deformer can accurately edit the source mesh following the shape…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Hao Su , Xuefeng Liu , Jianwei Niu , Ji Wan , Xinghao Wu

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

Morphable Models (3DMMs) are a type of morphable model that takes 2D images as inputs and recreates the structure and physical appearance of 3D objects, especially human faces and bodies. 3DMM combines identity and expression blendshapes…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Gulraiz Khan , Kenneth Y. Wertheim , Kevin Pimbblet , Waqas Ahmed

Face recognition is a widely accepted biometric verification tool, as the face contains a lot of information about the identity of a person. In this study, a 2-step neural-based pipeline is presented for matching 3D facial shape to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Soha Sadat Mahdi , Nele Nauwelaers , Philip Joris , Giorgos Bouritsas , Shunwang Gong , Sergiy Bokhnyak , Susan Walsh , Mark D. Shriver , Michael Bronstein , Peter Claes , .

3D face reconstruction and face alignment are two fundamental and highly related topics in computer vision. Recently, some works start to use deep learning models to estimate the 3DMM coefficients to reconstruct 3D face geometry. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zihao Jian , Minshan Xie

People represent their emotions in a myriad of ways. Among the most important ones is whole body expressions which have many applications in different fields such as human-computer interaction (HCI). One of the most important challenges in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Peyman Tahghighi , Abbas Koochari , Masoume Jalali

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

An efficient, fully automatic method for 3D face shape and pose estimation in unconstrained 2D imagery is presented. The proposed method jointly estimates a dense set of 3D landmarks and facial geometry using a single pass of a modified…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Daniel Crispell , Maxim Bazik

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer