English
Related papers

Related papers: Single-Shot Implicit Morphable Faces with Consiste…

200 papers

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

Video-driven 3D facial animation transfer aims to drive avatars to reproduce the expressions of actors. Existing methods have achieved remarkable results by constraining both geometric and perceptual consistency. However, geometric…

Graphics · Computer Science 2024-10-10 Feng Qiu , Wei Zhang , Chen Liu , Rudong An , Lincheng Li , Yu Ding , Changjie Fan , Zhipeng Hu , Xin Yu

Standard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mehdi Bahri , Eimear O' Sullivan , Shunwang Gong , Feng Liu , Xiaoming Liu , Michael M. Bronstein , Stefanos Zafeiriou

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces. Specifically, the suboptimally disentangled identity information of driving subjects would inevitably interfere with the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

We propose 360{\deg} Volumetric Portrait (3VP) Avatar, a novel method for reconstructing 360{\deg} photo-realistic portrait avatars of human subjects solely based on monocular video inputs. State-of-the-art monocular avatar reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Jalees Nehvi , Berna Kabadayi , Julien Valentin , Justus Thies

3D face reconstruction from a single image is a classical and challenging problem, with wide applications in many areas. Inspired by recent works in face animation from RGB-D or monocular video inputs, we develop a novel method for…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Luo Jiang , Juyong Zhang , Bailin Deng , Hao Li , Ligang Liu

With the increasing demands of applications in virtual reality such as 3D films, virtual Human-Machine Interactions and virtual agents, the analysis of 3D human face analysis is considered to be more and more important as a fundamental step…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Shu Zhang , Hui Yu , Ting Wang , Junyu Dong , Honghai Liu

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

Controllability, generalizability and efficiency are the major objectives of constructing face avatars represented by neural implicit field. However, existing methods have not managed to accommodate the three requirements simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zhiyuan Ma , Xiangyu Zhu , Guojun Qi , Zhen Lei , Lei Zhang

For 3D face modeling, the recently developed 3D-aware neural rendering methods are able to render photorealistic face images with arbitrary viewing directions. The training of the parametric controllable 3D-aware face models, however, still…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Peizhi Yan , Rabab K. Ward , Dan Wang , Qiang Tang , Shan Du

Recent advances in neural radiance fields enable novel view synthesis of photo-realistic images in dynamic settings, which can be applied to scenarios with human animation. Commonly used implicit backbones to establish accurate models,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 HyunJun Jung , Nikolas Brasch , Jifei Song , Eduardo Perez-Pellitero , Yiren Zhou , Zhihao Li , Nassir Navab , Benjamin Busam

With the rapid development of Role-Playing Games (RPGs), players are now allowed to edit the facial appearance of their in-game characters with their preferences rather than using default templates. This paper proposes a game character…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Tianyang Shi , Zhengxia Zou , Yi Yuan , Changjie Fan

Volumetric modeling and neural radiance field representations have revolutionized 3D face capture and photorealistic novel view synthesis. However, these methods often require hundreds of multi-view input images and are thus inapplicable to…

This paper presents a method that can quickly adapt dynamic 3D avatars to arbitrary text descriptions of novel styles. Among existing approaches for avatar stylization, direct optimization methods can produce excellent results for arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Thu Nguyen-Phuoc , Gabriel Schwartz , Yuting Ye , Stephen Lombardi , Lei Xiao

Acquiring the virtual equivalent of exhibits, such as sculptures, in virtual reality (VR) museums, can be labour-intensive and sometimes infeasible. Deep learning based 3D reconstruction approaches allow us to recover 3D shapes from 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ziyi Chang , George Alex Koulieris , Hubert P. H. Shum

In this paper, we introduce FitMe, a facial reflectance model and a differentiable rendering optimization pipeline, that can be used to acquire high-fidelity renderable human avatars from single or multiple images. The model consists of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Alexandros Lattas , Stylianos Moschoglou , Stylianos Ploumpis , Baris Gecer , Jiankang Deng , Stefanos Zafeiriou

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

Personalised 3D vascular models are valuable for diagnosis, prognosis and treatment planning in patients with cardiovascular disease. Traditionally, such models have been constructed with explicit representations such as meshes and voxel…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Dieuwertje Alblas , Christoph Brune , Kak Khee Yeung , Jelmer M. Wolterink

Reconstructing 3D human faces in the wild with the 3D Morphable Model (3DMM) has become popular in recent years. While most prior work focuses on estimating more robust and accurate geometry, relatively little attention has been paid to…

Graphics · Computer Science 2020-11-26 Myunggi Lee , Wonwoong Cho , Moonheum Kim , David Inouye , Nojun Kwak