English
Related papers

Related papers: Towards Native Generative Model for 3D Head Avatar

200 papers

Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Chaoqun Gong , Yuqin Dai , Ronghui Li , Achun Bao , Jun Li , Jian Yang , Yachao Zhang , Xiu Li

Real-time rendering of high-fidelity and animatable avatars from monocular videos remains a challenging problem in computer vision and graphics. Over the past few years, the Neural Radiance Field (NeRF) has made significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Qipeng Yan , Mingyang Sun , Lihua Zhang

A crucial ability of human intelligence is to build up models of individual 3D objects from partial scene observations. Recent works achieve object-centric generation but without the ability to infer the representation, or achieve 3D scene…

Machine Learning · Computer Science 2021-07-05 Chang Chen , Fei Deng , Sungjin Ahn

The problem of modeling an animatable 3D human head avatar under light-weight setups is of significant importance but has not been well solved. Existing 3D representations either perform well in the realism of portrait images synthesis or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiaochen Zhao , Lizhen Wang , Jingxiang Sun , Hongwen Zhang , Jinli Suo , Yebin Liu

In recent years, generative 3D face models (e.g., EG3D) have been developed to tackle the problem of synthesizing photo-realistic faces. However, these models are often unable to capture facial features unique to each individual,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Luchao Qi , Jiaye Wu , Annie N. Wang , Shengze Wang , Roni Sengupta

Generating high-fidelity upper-body 3D avatars from one-shot input image remains a significant challenge. Current 3D avatar generation methods, which rely on large reconstruction models, are fast and capable of producing stable body…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Fan Yang , Heyuan Li , Peihao Li , Weihao Yuan , Lingteng Qiu , Chaoyue Song , Cheng Chen , Yisheng He , Shifeng Zhang , Xiaoguang Han , Steven Hoi , Guosheng Lin

In this work, we introduce a novel high-fidelity 3D head reconstruction method from a single portrait image, regardless of perspective, expression, or accessories. Despite significant efforts in adapting 2D generative models for novel view…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Jianfu Zhang , Yujie Gao , Jiahui Zhan , Wentao Wang , Yiyi Zhang , Haohua Zhao , Liqing Zhang

Talking head video generation aims to produce a synthetic human face video that contains the identity and pose information respectively from a given source image and a driving video.Existing works for this task heavily rely on 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Fa-Ting Hong , Longhao Zhang , Li Shen , Dan Xu

Toward unlocking the potential of generative models in immersive 4D experiences, we introduce Virtual Pet, a novel pipeline to model realistic and diverse motions for target animal species within a 3D environment. To circumvent the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yen-Chi Cheng , Chieh Hubert Lin , Chaoyang Wang , Yash Kant , Sergey Tulyakov , Alexander Schwing , Liangyan Gui , Hsin-Ying Lee

Reconstructing high-fidelity 3D head avatars is crucial in various applications such as virtual reality. The pioneering methods reconstruct realistic head avatars with Neural Radiance Fields (NeRF), which have been limited by training and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Peng Chen , Xiaobao Wei , Qingpo Wuwu , Xinyi Wang , Xingyu Xiao , Ming Lu

Facial expression generation is one of the most challenging and long-sought aspects of character animation, with many interesting applications. The challenging task, traditionally having relied heavily on digital craftspersons, remains yet…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Kaifeng Zou , Sylvain Faisan , Boyang Yu , Sébastien Valette , Hyewon Seo

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

Advances in 3D-aware generative models have pushed the boundary of image synthesis with explicit camera control. To achieve high-resolution image synthesis, several attempts have been made to design efficient generators, such as hybrid…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Mallikarjun B R , Xingang Pan , Mohamed Elgharib , Christian Theobalt

Personalized 3D avatar editing holds significant promise due to its user-friendliness and availability to applications such as AR/VR and virtual try-ons. Previous studies have explored the feasibility of 3D editing, but often struggle to…

Graphics · Computer Science 2025-04-30 Hanxi Liu , Yifang Men , Zhouhui Lian

Photorealistic and animatable human avatars are a key enabler for virtual/augmented reality, telepresence, and digital entertainment. While recent advances in 3D Gaussian Splatting (3DGS) have greatly improved rendering quality and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Cheng Peng , Jingxiang Sun , Yushuo Chen , Zhaoqi Su , Zhuo Su , Yebin Liu

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

By equipping the most recent 3D Gaussian Splatting representation with head 3D morphable models (3DMM), existing methods manage to create head avatars with high fidelity. However, most existing methods only reconstruct a head without the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Tianhao Wu , Jing Yang , Zhilin Guo , Jingyi Wan , Fangcheng Zhong , Cengiz Oztireli

Generating complete 3D objects under partial occlusions (i.e., amodal scenarios) is a practically important yet challenging problem, as large portions of object geometry are unobserved in real-world scenarios. Existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Junwei Zhou , Yu-Wing Tai

To endow machines with the ability to perceive the real-world in a three dimensional representation as we do as humans is a fundamental and long-standing topic in Artificial Intelligence. Given different types of visual inputs such as…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Bo Yang

Generating 3D models lies at the core of computer graphics and has been the focus of decades of research. With the emergence of advanced neural representations and generative models, the field of 3D content generation is developing rapidly,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xiaoyu Li , Qi Zhang , Di Kang , Weihao Cheng , Yiming Gao , Jingbo Zhang , Zhihao Liang , Jing Liao , Yan-Pei Cao , Ying Shan