English
Related papers

Related papers: AvatarCraft: Transforming Text into Neural Human A…

200 papers

We propose a deep videorealistic 3D human character model displaying highly realistic shape, motion, and dynamic appearance learned in a new weakly supervised way from multi-view imagery. In contrast to previous work, our controllable 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Marc Habermann , Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

We present PartNerFace, a part-based neural radiance fields approach, for reconstructing animatable facial avatar from monocular RGB videos. Existing solutions either simply condition the implicit network with the morphable model parameters…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Xianggang Yu , Lingteng Qiu , Xiaohang Ren , Guanying Chen , Shuguang Cui , Xiaoguang Han , Baoyuan Wang

Neural implicit surface representations have emerged as a promising paradigm to capture 3D shapes in a continuous and resolution-independent manner. However, adapting them to articulated shapes is non-trivial. Existing approaches learn a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Xu Chen , Yufeng Zheng , Michael J. Black , Otmar Hilliges , Andreas Geiger

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries. Generally, two challenges remain in this field: i) existing methods struggle to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuanmeng Zhang , Jianfeng Zhang , Rohan Chacko , Hongyi Xu , Guoxian Song , Yi Yang , Jiashi Feng

Recent advances in neural radiance fields enable novel view synthesis of photo-realistic images in dynamic settings, which can be applied to scenarios with human animation. Commonly used implicit backbones to establish accurate models,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 HyunJun Jung , Nikolas Brasch , Jifei Song , Eduardo Perez-Pellitero , Yiren Zhou , Zhihao Li , Nassir Navab , Benjamin Busam

We propose a method for synthesizing edited photo-realistic digital avatars with text instructions. Given a short monocular RGB video and text instructions, our method uses an image-conditioned diffusion model to edit one head image and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Shaoxu Li

Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Baixin Xu , Jiarui Zhang , Kwan-Yee Lin , Chen Qian , Ying He

Implicit radiance functions emerged as a powerful scene representation for reconstructing and rendering photo-realistic views of a 3D scene. These representations, however, suffer from poor editability. On the other hand, explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Li Ma , Xiaoyu Li , Jing Liao , Xuan Wang , Qi Zhang , Jue Wang , Pedro Sander

SmartAvatar is a vision-language-agent-driven framework for generating fully rigged, animation-ready 3D human avatars from a single photo or textual prompt. While diffusion-based methods have made progress in general 3D object generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Alexander Huang-Menders , Xinhang Liu , Andy Xu , Yuyao Zhang , Chi-Keung Tang , Yu-Wing Tai

Deep learning greatly improved the realism of animatable human models by learning geometry and appearance from collections of 3D scans, template meshes, and multi-view imagery. High-resolution models enable photo-realistic avatars but at…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Shih-Yang Su , Timur Bagautdinov , Helge Rhodin

Acquisition and creation of digital human avatars is an important problem with applications to virtual telepresence, gaming, and human modeling. Most contemporary approaches for avatar generation can be viewed either as 3D-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Amit Raj , Umar Iqbal , Koki Nagano , Sameh Khamis , Pavlo Molchanov , James Hays , Jan Kautz

Accurate representations of 3D faces are of paramount importance in various computer vision and graphics applications. However, the challenges persist due to the limitations imposed by data discretization and model linearity, which hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Mingwu Zheng , Haiyu Zhang , Hongyu Yang , Liming Chen , Di Huang

The combination of traditional rendering with neural networks in Deferred Neural Rendering (DNR) provides a compelling balance between computational complexity and realism of the resulting images. Using skinned meshes for rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Amit Raj , Julian Tanke , James Hays , Minh Vo , Carsten Stoll , Christoph Lassner

The rising demand for creating lifelike avatars in the digital realm has led to an increased need for generating high-quality human videos guided by textual descriptions and poses. We propose Dancing Avatar, designed to fabricate human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Bosheng Qin , Wentao Ye , Qifan Yu , Siliang Tang , Yueting Zhuang

3D representation and reconstruction of human bodies have been studied for a long time in computer vision. Traditional methods rely mostly on parametric statistical linear models, limiting the space of possible bodies to linear…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sandro Lombardi , Bangbang Yang , Tianxing Fan , Hujun Bao , Guofeng Zhang , Marc Pollefeys , Zhaopeng Cui

This paper presents a new approach for 3D shape generation, inversion, and manipulation, through a direct generative modeling on a continuous implicit representation in wavelet domain. Specifically, we propose a compact wavelet…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Jingyu Hu , Ka-Hei Hui , Zhengzhe Liu , Ruihui Li , Chi-Wing Fu

Neural radiance fields are capable of reconstructing high-quality drivable human avatars but are expensive to train and render and not suitable for multi-human scenes with complex shadows. To reduce consumption, we propose Animatable 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yang Liu , Xiang Huang , Minghan Qin , Qinwei Lin , Haoqian Wang

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

Existing neural rendering methods for creating human avatars typically either require dense input signals such as video or multi-view images, or leverage a learned prior from large-scale specific 3D human datasets such that reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Yangyi Huang , Hongwei Yi , Weiyang Liu , Haofan Wang , Boxi Wu , Wenxiao Wang , Binbin Lin , Debing Zhang , Deng Cai

With the booming of virtual reality (VR) technology, there is a growing need for customized 3D avatars. However, traditional methods for 3D avatar modeling are either time-consuming or fail to retain similarity to the person being modeled.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Chuanyu Pan , Guowei Yang , Taijiang Mu , Yu-Kun Lai