English
Related papers

Related papers: AvatarCraft: Transforming Text into Neural Human A…

200 papers

We introduce SimAvatar, a framework designed to generate simulation-ready clothed 3D human avatars from a text prompt. Current text-driven human avatar generation methods either model hair, clothing, and the human body using a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Xueting Li , Ye Yuan , Shalini De Mello , Gilles Daviet , Jonathan Leaf , Miles Macklin , Jan Kautz , Umar Iqbal

Large-scale pre-trained vision-language models allow for the zero-shot text-based generation of 3D avatars. The previous state-of-the-art method utilized CLIP to supervise neural implicit models that reconstructed a human body mesh.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Shuo Huang , Zongxin Yang , Liangting Li , Yi Yang , Jia Jia

In this paper, we aim to create generalizable and controllable neural signed distance fields (SDFs) that represent clothed humans from monocular depth observations. Recent advances in deep learning, especially neural implicit…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Shaofei Wang , Marko Mihajlovic , Qianli Ma , Andreas Geiger , Siyu Tang

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

Synthesizing photorealistic 4D human head avatars from videos is essential for VR/AR, telepresence, and video game applications. Although existing Neural Radiance Fields (NeRF)-based methods achieve high-fidelity results, the computational…

Graphics · Computer Science 2023-11-29 Hao-Bin Duan , Miao Wang , Jin-Chuan Shi , Xu-Chuan Chen , Yan-Pei Cao

It is extremely challenging to create an animatable clothed human avatar from RGB videos, especially for loose clothes due to the difficulties in motion modeling. To address this problem, we introduce a novel representation on the basis of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zerong Zheng , Han Huang , Tao Yu , Hongwen Zhang , Yandong Guo , Yebin Liu

Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these…

Graphics · Computer Science 2023-06-27 Yanran Guan , Andrei Chubarau , Ruby Rao , Derek Nowrouzezahrai

Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Ye Yuan , Xueting Li , Yangyi Huang , Shalini De Mello , Koki Nagano , Jan Kautz , Umar Iqbal

We present DreamHuman, a method to generate realistic animatable 3D human avatar models solely from textual descriptions. Recent text-to-3D methods have made considerable strides in generation, but are still lacking in important aspects.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Nikos Kolotouros , Thiemo Alldieck , Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Fieraru , Cristian Sminchisescu

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

Digital human avatars aim to simulate the dynamic appearance of humans in virtual environments, enabling immersive experiences across gaming, film, virtual reality, and more. However, the conventional process for creating and animating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Felix Taubner , Ruihang Zhang , Mathieu Tuli , Sherwin Bahmani , David B. Lindell

Very recently neural implicit rendering techniques have been rapidly evolved and shown great advantages in novel view synthesis and 3D scene reconstruction. However, existing neural rendering methods for editing purposes offer limited…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Bangbang Yang , Chong Bao , Junyi Zeng , Hujun Bao , Yinda Zhang , Zhaopeng Cui , Guofeng Zhang

3D human avatar animation aims at transforming a human avatar from an arbitrary initial pose to a specified target pose using deformation algorithms. Existing approaches typically divide this task into two stages: canonical template…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jian Shu , Nanjie Yao , Gangjian Zhang , Junlong Ren , Yu Feng , Hao Wang

Facial expression retargeting from humans to virtual characters is a useful technique in computer graphics and animation. Traditional methods use markers or blendshapes to construct a mapping between the human and avatar faces. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Juyong Zhang , Keyu Chen , Jianmin Zheng

The ability to generate diverse 3D articulated head avatars is vital to a plethora of applications, including augmented reality, cinematography, and education. Recent work on text-guided 3D object generation has shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Alexander W. Bergman , Wang Yifan , Gordon Wetzstein

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Active soft bodies can affect their shape through an internal actuation mechanism that induces a deformation. Similar to recent work, this paper utilizes a differentiable, quasi-static, and physics-based simulation layer to optimize for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Lingchen Yang , Byungsoo Kim , Gaspard Zoss , Baran Gözcü , Markus Gross , Barbara Solenthaler

We present Neural Generalized Implicit Functions(Neural-GIF), to animate people in clothing as a function of the body pose. Given a sequence of scans of a subject in various poses, we learn to animate the character for new poses. Existing…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Garvita Tiwari , Nikolaos Sarafianos , Tony Tung , Gerard Pons-Moll

We present DreamWaltz, a novel framework for generating and animating complex 3D avatars given text guidance and parametric human body prior. While recent methods have shown encouraging results for text-to-3D generation of common objects,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yukun Huang , Jianan Wang , Ailing Zeng , He Cao , Xianbiao Qi , Yukai Shi , Zheng-Jun Zha , Lei Zhang

Despite progress in human motion capture, existing multi-view methods often face challenges in estimating the 3D pose and shape of multiple closely interacting people. This difficulty arises from reliance on accurate 2D joint estimations,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Feichi Lu , Zijian Dong , Jie Song , Otmar Hilliges