English
Related papers

Related papers: Facial Expression Retargeting from Human to Avatar…

200 papers

People can innately recognize human facial expressions in unnatural forms, such as when depicted on the unusual faces drawn in cartoons or when applied to an animal's features. However, current machine learning algorithms struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Michael Stettler , Alexander Lappe , Nick Taubert , Martin Giese

We present AvatarReX, a new method for learning NeRF-based full-body avatars from video data. The learnt avatar not only provides expressive control of the body, hands and the face together, but also supports real-time animation and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zerong Zheng , Xiaochen Zhao , Hongwen Zhang , Boning Liu , Yebin Liu

Virtual Reality (VR) bares promise of social interactions that can feel more immersive than other media. Key to this is the ability to accurately animate a personalized photorealistic avatar, and hence the acquisition of the labels for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Chaitanya Patel , Shaojie Bai , Te-Li Wang , Jason Saragih , Shih-En Wei

Existing talking avatar methods typically adopt an image-to-video pipeline conditioned on a static reference image within the same scene as the target generation. This restricted, single-view perspective lacks sufficient temporal and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zujin Guo , Zhenhui Ye , Yi Ren , Yuanming Li , Ce Chen , Zhibin Hong , Chen Change Loy

Facial editing is an important task with applications in entertainment, virtual reality, and digital avatars. Most existing approaches rely on generative models in the 2D image domain, while in 3D the task is typically performed through…

In this research paper we suggest how to extract a face from an image, modify it, characterize it in terms of high-level properties, and apply it to the creation of a personalized avatar. In this research work we tested, we implemented the…

Computer Vision and Pattern Recognition · Computer Science 2012-10-24 Vibekananda Dutta , Dr Nishtha Kesswani , Deepti Gahalot

Real-time rendering of human head avatars is a cornerstone of many computer graphics applications, such as augmented reality, video games, and films, to name a few. Recent approaches address this challenge with computationally efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Kartik Teotia , Hyeongwoo Kim , Pablo Garrido , Marc Habermann , Mohamed Elgharib , Christian Theobalt

Stylized 3D avatars have become increasingly prominent in our modern life. Creating these avatars manually usually involves laborious selection and adjustment of continuous and discrete parameters and is time-consuming for average users.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Shen Sang , Tiancheng Zhi , Guoxian Song , Minghao Liu , Chunpong Lai , Jing Liu , Xiang Wen , James Davis , Linjie Luo

With the rapid development of Role-Playing Games (RPGs), players are now allowed to edit the facial appearance of their in-game characters with their preferences rather than using default templates. This paper proposes a game character…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Tianyang Shi , Zhengxia Zou , Yi Yuan , Changjie Fan

Producing expressive facial animations from static images is a challenging task. Prior methods relying on explicit geometric priors (e.g., facial landmarks or 3DMM) often suffer from artifacts in cross reenactment and struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Qiang Wang , Mengchao Wang , Fan Jiang , Yaqi Fan , Yonggang Qi , Mu Xu

Current text-to-avatar methods often rely on implicit representations (e.g., NeRF, SDF, and DMTet), leading to 3D content that artists cannot easily edit and animate in graphics software. This paper introduces a novel framework for…

Graphics · Computer Science 2025-05-01 Duotun Wang , Hengyu Meng , Zeyu Cai , Zhijing Shao , Qianxi Liu , Lin Wang , Mingming Fan , Xiaohang Zhan , Zeyu Wang

Face reenactment methods attempt to restore and re-animate portrait videos as realistically as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN-based methods achieve higher image quality but suffer in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lizhen Wang , Xiaochen Zhao , Jingxiang Sun , Yuxiang Zhang , Hongwen Zhang , Tao Yu , Yebin Liu

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

We consider the problem of computing accurate point-to-point correspondences among a set of human face scans with varying expressions. Our fully automatic approach does not require any manually placed markers on the scan. Instead, the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-30 Augusto Salazar , Stefanie Wuhrer , Chang Shu , Flavio Prieto

We present a zero-shot framework for transferring human facial expressions to 3D animal face meshes. Our method combines intrinsic geometric descriptors (HKS/WKS) with a mesh-agnostic latent embedding that disentangles facial identity and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yue Wang , Lawrence Amadi , Xiang Gao , Yazheng Chen , Yuanpeng Liu , Ning Lu , Xianfeng Gu

We introduce AvatarBooth, a novel method for generating high-quality 3D avatars using text prompts or specific images. Unlike previous approaches that can only synthesize avatars based on simple text descriptions, our method enables the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Yifei Zeng , Yuanxun Lu , Xinya Ji , Yao Yao , Hao Zhu , Xun Cao

The ability to accurately capture and express emotions is a critical aspect of creating believable characters in video games and other forms of entertainment. Traditionally, this animation has been achieved with artistic effort or…

Graphics · Computer Science 2023-07-19 Jack Saunders , Steven Caulkin , Vinay Namboodiri

In this work we propose a model that can manipulate individual visual attributes of objects in a real scene using examples of how respective attribute manipulations affect the output of a simulation. As an example, we train our model to…

Machine Learning · Computer Science 2019-04-04 Ben Usman , Nick Dufour , Kate Saenko , Chris Bregler

We present a framework for generating full-bodied photorealistic avatars that gesture according to the conversational dynamics of a dyadic interaction. Given speech audio, we output multiple possibilities of gestural motion for an…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Evonne Ng , Javier Romero , Timur Bagautdinov , Shaojie Bai , Trevor Darrell , Angjoo Kanazawa , Alexander Richard

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…