English
Related papers

Related papers: High-Fidelity Human Avatars from Laptop Webcams us…

200 papers

Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Despite recent progress in developing animatable full-body avatars, realistic modeling of clothing - one of the core aspects of human self-expression - remains an open challenge. State-of-the-art physical simulation methods can generate…

We introduce GaussianAvatars, a new method to create photorealistic head avatars that are fully controllable in terms of expression, pose, and viewpoint. The core idea is a dynamic 3D representation based on 3D Gaussian splats that are…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Shenhan Qian , Tobias Kirschstein , Liam Schoneveld , Davide Davoli , Simon Giebenhain , Matthias Nießner

Photorealistic avatars are human avatars that look, move, and talk like real people. The performance of photorealistic avatars has significantly improved recently based on objective metrics such as PSNR, SSIM, LPIPS, FID, and FVD. However,…

Human-Computer Interaction · Computer Science 2025-04-08 Ross Cutler , Babak Naderi , Vishak Gopal , Dharmendar Palle

Over the last years, with the advent of Generative Adversarial Networks (GANs), many face analysis tasks have accomplished astounding performance, with applications including, but not limited to, face generation and 3D face reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Alexandros Lattas , Stylianos Moschoglou , Baris Gecer , Stylianos Ploumpis , Vasileios Triantafyllou , Abhijeet Ghosh , Stefanos Zafeiriou

Existing research on avatar creation is typically limited to laboratory datasets, which require high costs against scalability and exhibit insufficient representation of the real world. On the other hand, the web abounds with off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zihao Huang , Shoukang Hu , Guangcong Wang , Tianqi Liu , Yuhang Zang , Zhiguo Cao , Wei Li , Ziwei Liu

We present an audio-driven real-time system for animating photorealistic 3D facial avatars with minimal latency, designed for social interactions in virtual reality for anyone. Central to our approach is an encoder model that transforms…

Graphics · Computer Science 2025-11-04 Jiye Lee , Chenghui Li , Linh Tran , Shih-En Wei , Jason Saragih , Alexander Richard , Hanbyul Joo , Shaojie Bai

We present HARP (HAnd Reconstruction and Personalization), a personalized hand avatar creation approach that takes a short monocular RGB video of a human hand as input and reconstructs a faithful hand avatar exhibiting a high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Korrawe Karunratanakul , Sergey Prokudin , Otmar Hilliges , Siyu Tang

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

Generating photorealistic images of human faces at scale remains a prohibitively difficult task using computer graphics approaches. This is because these require the simulation of light to be photorealistic, which in turn requires…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Stephan J. Garbin , Marek Kowalski , Matthew Johnson , Jamie Shotton

Digital human generation has been studied for decades and supports a wide range of real-world applications. However, most existing systems are passively animated, relying on privileged state or scripted control, which limits scalability to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hang Ye , Xiaoxuan Ma , Fan Lu , Wayne Wu , Kwan-Yee Lin , Yizhou Wang

In this study, our goal is to create interactive avatar agents that can autonomously plan and animate nuanced facial movements realistically, from both visual and behavioral perspectives. Given high-level inputs about the environment and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Duomin Wang , Bin Dai , Yu Deng , Baoyuan Wang

Gaussian-based human avatars have achieved an unprecedented level of visual fidelity. However, existing approaches based on high-capacity neural networks typically require a desktop GPU to achieve real-time performance for a single avatar,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Forrest Iandola , Stanislav Pidhorskyi , Igor Santesteban , Divam Gupta , Anuj Pahuja , Nemanja Bartolovic , Frank Yu , Emanuel Garbin , Tomas Simon , Shunsuke Saito

3D human avatar animation aims at transforming a human avatar from an arbitrary initial pose to a specified target pose using deformation algorithms. Existing approaches typically divide this task into two stages: canonical template…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jian Shu , Nanjie Yao , Gangjian Zhang , Junlong Ren , Yu Feng , Hao Wang

The authentic 3D hand avatar with every identifiable information, such as hand shapes and textures, is necessary for immersive experiences in AR/VR. In this paper, we present a universal hand model (UHM), which 1) can universally represent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Gyeongsik Moon , Weipeng Xu , Rohan Joshi , Chenglei Wu , Takaaki Shiratori

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

High-fidelity reconstruction of 3D human avatars has a wild application in visual reality. In this paper, we introduce FAGhead, a method that enables fully controllable human portraits from monocular videos. We explicit the traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Yixin Xuan , Xinyang Li , Gongxin Yao , Shiwei Zhou , Donghui Sun , Xiaoxin Chen , Yu Pan

In recent years, facial video generation models have gained popularity. However, these models often lack expressive power when dealing with exaggerated anime-style faces due to the absence of high-quality anime-style face training sets. We…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaokai Chen , Xuan Liu , Donglin Di , Yongjia Ma , Wei Chen , Tonghua Su

We present R3-Avatar, incorporating a temporal codebook, to overcome the inability of human avatars to be both animatable and of high-fidelity rendering quality. Existing video-based reconstruction of 3D human avatars either focuses solely…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yifan Zhan , Wangze Xu , Qingtian Zhu , Muyao Niu , Mingze Ma , Yifei Liu , Zhihang Zhong , Xiao Sun , Yinqiang Zheng

Embodied avatars as virtual agents have many applications and provide benefits over disembodied agents, allowing non-verbal social and interactional cues to be leveraged, in a similar manner to how humans interact with each other. We…

Human-Computer Interaction · Computer Science 2019-10-16 Deepali Aneja , Daniel McDuff , Shital Shah