English
Related papers

Related papers: AvatarCraft: Transforming Text into Neural Human A…

200 papers

We introduce AvatarForge, a framework for generating animatable 3D human avatars from text or image inputs using AI-driven procedural generation. While diffusion-based methods have made strides in general 3D object generation, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Capturing and editing full head performances enables the creation of virtual characters with various applications such as extended reality and media production. The past few years witnessed a steep rise in the photorealism of human head…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Mohit Mendiratta , Xingang Pan , Mohamed Elgharib , Kartik Teotia , Mallikarjun B R , Ayush Tewari , Vladislav Golyanik , Adam Kortylewski , Christian Theobalt

The appearance of a human in clothing is driven not only by the pose but also by its temporal context, i.e., motion. However, such context has been largely neglected by existing monocular human modeling methods whose neural networks often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Hansol Lee , Junuk Cha , Yunhoe Ku , Jae Shin Yoon , Seungryul Baek

This paper proposes a technique for efficiently modeling dynamic humans by explicifying the implicit neural fields via a Neural Explicit Surface (NES). Implicit neural fields have advantages over traditional explicit representations in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruiqi Zhang , Jie Chen , Qiang Wang

To address the ill-posed problem caused by partial observations in monocular human volumetric capture, we present AvatarCap, a novel framework that introduces animatable avatars into the capture pipeline for high-fidelity reconstruction in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Zhe Li , Zerong Zheng , Hongwen Zhang , Chaonan Ji , Yebin Liu

Recent advances in video diffusion models have significantly improved character animation techniques. However, current approaches rely on basic structural conditions such as DWPose or SMPL-X to animate character images, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Muyao Niu , Mingdeng Cao , Yifan Zhan , Qingtian Zhu , Mingze Ma , Jiancheng Zhao , Yanhong Zeng , Zhihang Zhong , Xiao Sun , Yinqiang Zheng

The generation of high-quality, animatable 3D head avatars from text has enormous potential in content creation applications such as games, movies, and embodied virtual assistants. Current text-to-3D generation methods typically combine…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yiqian Wu , Malte Prinzler , Xiaogang Jin , Siyu Tang

We present Neural Head Avatars, a novel neural representation that explicitly models the surface geometry and appearance of an animatable human avatar that can be used for teleconferencing in AR/VR or other applications in the movie or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Philip-William Grassal , Malte Prinzler , Titus Leistner , Carsten Rother , Matthias Nießner , Justus Thies

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu

We propose a novel neural rendering pipeline, Hybrid Volumetric-Textural Rendering (HVTR), which synthesizes virtual human avatars from arbitrary poses efficiently and at high quality. First, we learn to encode articulated human motions on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Tao Hu , Tao Yu , Zerong Zheng , He Zhang , Yebin Liu , Matthias Zwicker

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

Rendering photorealistic and dynamically moving human heads is crucial for ensuring a pleasant and immersive experience in AR/VR and video conferencing applications. However, existing methods often struggle to model challenging facial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Cong Wang , Di Kang , Yan-Pei Cao , Linchao Bao , Ying Shan , Song-Hai Zhang

We present a novel approach for generating animatable 3D-aware art avatars from a single image, with controllable facial expressions, head poses, and shoulder movements. Unlike previous reenactment methods, our approach utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shaoxu Li

We present AvatarReX, a new method for learning NeRF-based full-body avatars from video data. The learnt avatar not only provides expressive control of the body, hands and the face together, but also supports real-time animation and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zerong Zheng , Xiaochen Zhao , Hongwen Zhang , Boning Liu , Yebin Liu

Lightweight creation of 3D digital avatars is a highly desirable but challenging task. With only sparse videos of a person under unknown illumination, we propose a method to create relightable and animatable neural avatars, which can be…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Wenbin Lin , Chengwei Zheng , Jun-Hai Yong , Feng Xu

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

Combining human body models with differentiable rendering has recently enabled animatable avatars of clothed humans from sparse sets of multi-view RGB videos. While state-of-the-art approaches achieve realistic appearance with neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Shaofei Wang , Katja Schwarz , Andreas Geiger , Siyu Tang

The problem of modeling an animatable 3D human head avatar under light-weight setups is of significant importance but has not been well solved. Existing 3D representations either perform well in the realism of portrait images synthesis or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiaochen Zhao , Lizhen Wang , Jingxiang Sun , Hongwen Zhang , Jinli Suo , Yebin Liu

Character customization, or 'face crafting,' is a vital feature in role-playing games (RPGs), enhancing player engagement by enabling the creation of personalized avatars. Existing automated methods often struggle with generalizability…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Suzhen Wang , Weijie Chen , Wei Zhang , Minda Zhao , Lincheng Li , Rongsheng Zhang , Zhipeng Hu , Xin Yu

Constructing and animating humans is an important component for building virtual worlds in a wide variety of applications such as virtual reality or robotics testing in simulation. As there are exponentially many variations of humans with…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Ze Yang , Shenlong Wang , Sivabalan Manivasagam , Zeng Huang , Wei-Chiu Ma , Xinchen Yan , Ersin Yumer , Raquel Urtasun