English
Related papers

Related papers: ImHead: A Large-scale Implicit Morphable Model for…

200 papers

3D facial animation has attracted considerable attention due to its extensive applications in the multimedia field. Audio-driven 3D facial animation has been widely explored with promising results. However, multi-modal 3D facial animation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Sijing Wu , Yunhao Li , Yichao Yan , Huiyu Duan , Ziwei Liu , Guangtao Zhai

Deep implicit functions (DIFs), as a kind of 3D shape representation, are becoming more and more popular in the 3D vision community due to their compactness and strong representation power. However, unlike polygon mesh-based templates, it…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Zerong Zheng , Tao Yu , Qionghai Dai , Yebin Liu

In this paper, we propose a novel hybrid representation and end-to-end trainable network architecture to model fully editable and customizable neural avatars. At the core of our work lies a representation that combines the modeling power of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Hsuan-I Ho , Lixin Xue , Jie Song , Otmar Hilliges

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

Reconstructing personalized animatable head avatars has significant implications in the fields of AR/VR. Existing methods for achieving explicit face control of 3D Morphable Models (3DMM) typically rely on multi-view images or videos of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Haoyu Ma , Tong Zhang , Shanlin Sun , Xiangyi Yan , Kun Han , Xiaohui Xie

Recent studies have combined 3D Gaussian and 3D Morphable Models (3DMM) to construct high-quality 3D head avatars. In this line of research, existing methods either fail to capture the dynamic textures or incur significant overhead in terms…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yating Wang , Xuan Wang , Ran Yi , Yanbo Fan , Jichen Hu , Jingcheng Zhu , Lizhuang Ma

Facial 3D Morphable Models are a main computer vision subject with countless applications and have been highly optimized in the last two decades. The tremendous improvements of deep generative networks have created various possibilities for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Stathis Galanakis , Baris Gecer , Alexandros Lattas , Stefanos Zafeiriou

One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces. Specifically, the suboptimally disentangled identity information of driving subjects would inevitably interfere with the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

To bring digital avatars into people's lives, it is highly demanded to efficiently generate complete, realistic, and animatable head avatars. This task is challenging, and it is difficult for existing methods to satisfy all the requirements…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Sijing Wu , Yichao Yan , Yunhao Li , Yuhao Cheng , Wenhan Zhu , Ke Gao , Xiaobo Li , Guangtao Zhai

In the realm of 3D computer vision, parametric models have emerged as a ground-breaking methodology for the creation of realistic and expressive 3D avatars. Traditionally, they rely on Principal Component Analysis (PCA), given its ability…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Rolandos Alexandros Potamias , Michail Tarasiou , Stylianos Ploumpis , Stefanos Zafeiriou

Implicit functions represented as deep learning approximations are powerful for reconstructing 3D surfaces. However, they can only produce static surfaces that are not controllable, which provides limited ability to modify the resulting…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Bharat Lal Bhatnagar , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

In recent decades, 3D morphable model (3DMM) has been commonly used in image-based photorealistic 3D face reconstruction. However, face images are often corrupted by serious occlusion by non-face objects including eyeglasses, masks, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Xiaowei Yuan , In Kyu Park

Parametric 3D models have enabled a wide variety of tasks in computer graphics and vision, such as modeling human bodies, faces, and hands. However, the construction of these parametric models is often tedious, as it requires heavy manual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Pablo Palafox , Aljaž Božič , Justus Thies , Matthias Nießner , Angela Dai

3D Morphable Models are a class of generative models commonly used to model faces. They are typically applied to ill-posed problems such as 3D reconstruction from 2D data. Several ambiguities in this problem's image formation process have…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Bernhard Egger , Skylar Sutherland , Safa C. Medin , Joshua Tenenbaum

Undoubtedly, high-fidelity 3D hair plays an indispensable role in digital humans. However, existing monocular hair modeling methods are either tricky to deploy in digital systems (e.g., due to their dependence on complex user interactions…

Graphics · Computer Science 2022-05-10 Keyu Wu , Yifan Ye , Lingchen Yang , Hongbo Fu , Kun Zhou , Youyi Zheng

Face image manipulation via three-dimensional guidance has been widely applied in various interactive scenarios due to its semantically-meaningful understanding and user-friendly controllability. However, existing 3D-morphable-model-based…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Can Wang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Generating and editing dynamic 3D head avatars are crucial tasks in virtual reality and film production. However, existing methods often suffer from facial distortions, inaccurate head movements, and limited fine-grained editing…

Graphics · Computer Science 2024-11-26 Yangyang Qian , Yuan Sun , Yu Guo

Deep implicit functions have shown remarkable shape modeling ability in various 3D computer vision tasks. One drawback is that it is hard for them to represent a 3D shape as multiple parts. Current solutions learn various primitives and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chao Chen , Yu-Shen Liu , Zhizhong Han

Animatable 3D human reconstruction from a single image is a challenging problem due to the ambiguity in decoupling geometry, appearance, and deformation. Recent advances in 3D human reconstruction mainly focus on static human modeling, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Lingteng Qiu , Xiaodong Gu , Peihao Li , Qi Zuo , Weichao Shen , Junfei Zhang , Kejie Qiu , Weihao Yuan , Guanying Chen , Zilong Dong , Liefeng Bo

Shape priors have long been known to be effective when reconstructing 3D shapes from noisy or incomplete data. When using a deep-learning based shape representation, this often involves learning a latent representation, which can be either…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Patrick M. Jensen , Udaranga Wickramasinghe , Anders B. Dahl , Pascal Fua , Vedrana A. Dahl