English
Related papers

Related papers: High-Fidelity Human Avatars from Laptop Webcams us…

200 papers

Over the last few decades, many aspects of human life have been enhanced with virtual domains, from the advent of digital assistants such as Amazon's Alexa and Apple's Siri to the latest metaverse efforts of the rebranded Meta. These trends…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Siddarth Ravichandran , Ondřej Texler , Dimitar Dinev , Hyun Jae Kang

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

We propose a method for synthesizing photo-realistic digital avatars from only one portrait as the reference. Given a portrait, our method synthesizes a coarse talking head video using driving keypoints features. And with the coarse video,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Shaoxu Li

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

We present a fully automatic system that can produce high-fidelity, photo-realistic 3D digital human heads with a consumer RGB-D selfie camera. The system only needs the user to take a short selfie RGB-D video while rotating his/her head,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Linchao Bao , Xiangkai Lin , Yajing Chen , Haoxian Zhang , Sheng Wang , Xuefei Zhe , Di Kang , Haozhi Huang , Xinwei Jiang , Jue Wang , Dong Yu , Zhengyou Zhang

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

Photorealistic and controllable human avatars have gained popularity in the research community thanks to rapid advances in neural rendering, providing fast and realistic synthesis tools. However, a limitation of current solutions is the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Mohamed Ilyes Lakhal , Richard Bowden

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruihe Wang , Yukang Cao , Kai Han , Kwan-Yee K. Wong

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

The creation of high-fidelity, digital versions of human heads is an important stepping stone in the process of further integrating virtual components into our everyday lives. Constructing such avatars is a challenging research problem, due…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Simon Giebenhain , Tobias Kirschstein , Martin Rünz , Lourdes Agapito , Matthias Nießner

We study the problem of creating high-fidelity and animatable 3D avatars from only textual descriptions. Existing text-to-avatar methods are either limited to static avatars which cannot be animated or struggle to generate animatable…

Graphics · Computer Science 2023-11-30 Jianfeng Zhang , Xuanmeng Zhang , Huichao Zhang , Jun Hao Liew , Chenxu Zhang , Yi Yang , Jiashi Feng

We have recently seen great progress in building photorealistic animatable full-body codec avatars, but generating high-fidelity animation of clothing is still difficult. To address these difficulties, we propose a method to build an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Donglai Xiang , Fabian Prada , Timur Bagautdinov , Weipeng Xu , Yuan Dong , He Wen , Jessica Hodgins , Chenglei Wu

With the booming of virtual reality (VR) technology, there is a growing need for customized 3D avatars. However, traditional methods for 3D avatar modeling are either time-consuming or fail to retain similarity to the person being modeled.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Chuanyu Pan , Guowei Yang , Taijiang Mu , Yu-Kun Lai

We present a high-precision real-time facial animation pipeline suitable for animators to use on their desktops. This pipeline is about to be launched in FACEGOOD's Avatary\footnote{https://www.avatary.com/} software, which will accelerate…

Graphics · Computer Science 2023-04-07 Wei Chen , HongWei Xu , Jelo Wang

We introduce a novel approach to creating ultra-realistic head avatars and rendering them in real-time (>30fps at $2048 \times 1334$ resolution). First, we propose a hybrid explicit representation that combines the advantages of two…

Graphics · Computer Science 2025-02-20 Hongrui Cai , Yuting Xiao , Xuan Wang , Jiafei Li , Yudong Guo , Yanbo Fan , Shenghua Gao , Juyong Zhang

Building 3D animatable head avatars from a single image is an important yet challenging problem. Existing methods generally collapse under large camera pose variations, compromising the realism of 3D avatars. In this work, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shuling Zhao , Dan Xu

We present SimXR, a method for controlling a simulated avatar from information (headset pose and cameras) obtained from AR / VR headsets. Due to the challenging viewpoint of head-mounted cameras, the human body is often clipped out of view,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhengyi Luo , Jinkun Cao , Rawal Khirodkar , Alexander Winkler , Jing Huang , Kris Kitani , Weipeng Xu

We introduce a novel framework for 3D human avatar generation and personalization, leveraging text prompts to enhance user engagement and customization. Central to our approach are key innovations aimed at overcoming the challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Armand Comas-Massagué , Di Qiu , Menglei Chai , Marcel Bühler , Amit Raj , Ruiqi Gao , Qiangeng Xu , Mark Matthews , Paulo Gotardo , Octavia Camps , Sergio Orts-Escolano , Thabo Beeler

The problem of modeling an animatable 3D human head avatar under light-weight setups is of significant importance but has not been well solved. Existing 3D representations either perform well in the realism of portrait images synthesis or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiaochen Zhao , Lizhen Wang , Jingxiang Sun , Hongwen Zhang , Jinli Suo , Yebin Liu