English
Related papers

Related papers: Data-Driven Physical Face Inversion

200 papers

Many deep learning based 3D face reconstruction methods have been proposed recently, however, few of them have applications in games. Current game character customization systems either require players to manually adjust considerable face…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Jiangke Lin , Yi Yuan , Zhengxia Zou

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

We present FastAvatar, a fast and robust algorithm for single-image 3D face reconstruction using 3D Gaussian Splatting (3DGS). Given a single input image from an arbitrary pose, FastAvatar recovers a high-quality, full-head 3DGS avatar in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hao Liang , Zhixuan Ge , Soumendu Majee , Ashish Tiwari , G. M. Dilshan Godaliyadda , Ashok Veeraraghavan , Guha Balakrishnan

Authoring an appealing animation for a virtual character is a challenging task. In computer-aided keyframe animation artists define the key poses of a character by manipulating its underlying skeletons. To look plausible, a character pose…

Graphics · Computer Science 2021-07-02 Léon Victor , Alexandre Meyer , Saïda Bouakaz

Face reenactment aims to generate realistic talking head videos by transferring motion from a driving video to a static source image while preserving the source identity. Although existing methods based on either implicit or explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Mingtao Guo , Guanyu Xing , Yanci Zhang , Yanli Liu

With the increasing demands of applications in virtual reality such as 3D films, virtual Human-Machine Interactions and virtual agents, the analysis of 3D human face analysis is considered to be more and more important as a fundamental step…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Shu Zhang , Hui Yu , Ting Wang , Junyu Dong , Honghai Liu

Transferring human motion and appearance between videos of human actors remains one of the key challenges in Computer Vision. Despite the advances from recent image-to-image translation approaches, there are several transferring contexts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Thiago L. Gomes , Renato Martins , João Ferreira , Rafael Azevedo , Guilherme Torres , Erickson R. Nascimento

Creating plausible virtual actors from images of real actors remains one of the key challenges in computer vision and computer graphics. Marker-less human motion estimation and shape modeling from images in the wild bring this challenge to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Thiago L. Gomes , Renato Martins , João Ferreira , Erickson R. Nascimento

Generating faithful visualizations of human faces requires capturing both coarse and fine-level details of the face geometry and appearance. Existing methods are either data-driven, requiring an extensive corpus of data not publicly…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Kacper Kania , Stephan J. Garbin , Andrea Tagliasacchi , Virginia Estellers , Kwang Moo Yi , Julien Valentin , Tomasz Trzciński , Marek Kowalski

3D face reconstruction plays a very important role in many real-world multimedia applications, including digital entertainment, social media, affection analysis, and person identification. The de-facto pipeline for estimating the parametric…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Jialiang Zhang , Lixiang Lin , Jianke Zhu , Steven C. H. Hoi

Recent advances in digital avatar technology have enabled the generation of compelling virtual characters, but deploying these avatars on compute-constrained devices poses significant challenges for achieving realistic garment deformations.…

4D face reconstruction from a single camera is a challenging task, especially when it is required to be performed in real time. We demonstrate a system of our own implementation that solves this task accurately and runs in real time on a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Mohammad Rami Koujan , Nikolai Dochev , Anastasios Roussos

We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For the large differences between pareidolia face reenactment…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Linsen Song , Wayne Wu , Chaoyou Fu , Chen Qian , Chen Change Loy , Ran He

One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces. Specifically, the suboptimally disentangled identity information of driving subjects would inevitably interfere with the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

We propose HeadOn, the first real-time source-to-target reenactment approach for complete human portrait videos that enables transfer of torso and head motion, face expression, and eye gaze. Given a short RGB-D video of the target actor, we…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Justus Thies , Michael Zollhöfer , Christian Theobalt , Marc Stamminger , Matthias Nießner

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

High-fidelity reconstruction of 3D human avatars has a wild application in visual reality. In this paper, we introduce FAGhead, a method that enables fully controllable human portraits from monocular videos. We explicit the traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Yixin Xuan , Xinyang Li , Gongxin Yao , Shiwei Zhou , Donghui Sun , Xiaoxin Chen , Yu Pan

Face animation aims at creating photo-realistic portrait videos with animated poses and expressions. A common practice is to generate displacement fields that are used to warp pixels and features from source to target. However, prior…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yatao Zhong , Faezeh Amjadi , Ilya Zharkov

Audio-driven facial reenactment is a crucial technique that has a range of applications in film-making, virtual avatars and video conferences. Existing works either employ explicit intermediate face representations (e.g., 2D facial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Ricong Huang , Peiwen Lai , Yipeng Qin , Guanbin Li