English
Related papers

Related papers: $E^{3}$Gen: Efficient, Expressive and Editable Ava…

200 papers

We introduce PortraitGen, a powerful portrait video editing method that achieves consistent and expressive stylization with multimodal prompts. Traditional portrait video editing methods often struggle with 3D and temporal consistency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xuan Gao , Haiyao Xiao , Chenglai Zhong , Shimin Hu , Yudong Guo , Juyong Zhang

We introduce ELITE, an Efficient Gaussian head avatar synthesis from a monocular video via Learned Initialization and TEst-time generative adaptation. Prior works rely either on a 3D data prior or a 2D generative prior to compensate for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Kim Youwang , Lee Hyoseok , Subin Park , Gerard Pons-Moll , Tae-Hyun Oh

Current personalized neural head avatars face a trade-off: lightweight models lack detail and realism, while high-quality, animatable avatars require significant computational resources, making them unsuitable for commodity devices. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wojciech Zielonka , Timo Bolkart , Thabo Beeler , Justus Thies

Recent advances in diffusion models have made significant progress in digital human generation. However, most existing models still struggle to maintain 3D consistency, temporal coherence, and motion accuracy. A key reason for these…

Graphics · Computer Science 2025-03-21 Xuan Gao , Jingtao Zhou , Dongyu Liu , Yuqi Zhou , Juyong Zhang

Learning 3D head priors from large 2D image collections is an important step towards high-quality 3D-aware human modeling. A core requirement is an efficient architecture that scales well to large-scale datasets and large image resolutions.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Tobias Kirschstein , Simon Giebenhain , Jiapeng Tang , Markos Georgopoulos , Matthias Nießner

While progress in 2D generative models of human appearance has been rapid, many applications require 3D avatars that can be animated and rendered. Unfortunately, most existing methods for learning generative models of 3D humans with diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Zijian Dong , Xu Chen , Jinlong Yang , Michael J. Black , Otmar Hilliges , Andreas Geiger

Inverse graphics aims to recover 3D models from 2D observations. Utilizing differentiable rendering, recent 3D-aware generative models have shown impressive results of rigid object generation using 2D images. However, it remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Fangzhou Hong , Zhaoxi Chen , Yushi Lan , Liang Pan , Ziwei Liu

Although 2D generative models have made great progress in face image generation and animation, they often suffer from undesirable artifacts such as 3D inconsistency when rendering images from different camera viewpoints. This prevents them…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yue Wu , Yu Deng , Jiaolong Yang , Fangyun Wei , Qifeng Chen , Xin Tong

Constructing vivid 3D head avatars for given subjects and realizing a series of animations on them is valuable yet challenging. This paper presents GaussianHead, which models the actional human head with anisotropic 3D Gaussians. In our…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Jie Wang , Jiu-Cheng Xie , Xianyan Li , Feng Xu , Chi-Man Pun , Hao Gao

In recent times, the generation of 3D assets from text prompts has shown impressive results. Both 2D and 3D diffusion models can help generate decent 3D objects based on prompts. 3D diffusion models have good 3D consistency, but their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Taoran Yi , Jiemin Fang , Junjie Wang , Guanjun Wu , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Qi Tian , Xinggang Wang

We introduce 3D Gaussian blendshapes for modeling photorealistic head avatars. Taking a monocular video as input, we learn a base head model of neutral expression, along with a group of expression blendshapes, each of which corresponds to a…

Graphics · Computer Science 2024-05-03 Shengjie Ma , Yanlin Weng , Tianjia Shao , Kun Zhou

The creation of 3D human avatars from multi-view videos is a significant yet challenging task in computer vision. However, existing techniques rely on high-quality, sharp images as input, which are often impractical to obtain in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Muyao Niu , Yifan Zhan , Qingtian Zhu , Zhuoxiao Li , Wei Wang , Zhihang Zhong , Xiao Sun , Yinqiang Zheng

Creating and customizing a 3D clothed avatar from textual descriptions is a critical and challenging task. Traditional methods often treat the human body and clothing as inseparable, limiting users' ability to freely mix and match garments.…

Graphics · Computer Science 2025-03-18 Jia Gong , Shenyu Ji , Lin Geng Foo , Kang Chen , Hossein Rahmani , Jun Liu

3D human digitization has long been a highly pursued yet challenging task. Existing methods aim to generate high-quality 3D digital humans from single or multiple views, but remain primarily constrained by current paradigms and the scarcity…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yuhang Yang , Fengqi Liu , Yixing Lu , Qin Zhao , Pingyu Wu , Wei Zhai , Ran Yi , Yang Cao , Lizhuang Ma , Zheng-Jun Zha , Junting Dong

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

With the rapid advancement of 3D representation techniques and generative models, substantial progress has been made in reconstructing full-body 3D avatars from a single image. However, this task remains fundamentally ill-posedness due to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Gaofeng Liu , Hengsen Li , Ruoyu Gao , Xuetong Li , Zhiyuan Ma , Tao Fang

We propose a novel framework for simultaneously generating and manipulating the face images with desired attributes. While the state-of-the-art attribute editing technique has achieved the impressive performance for creating realistic…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Kyungjune Baek , Duhyeon Bang , Hyunjung Shim

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries. Generally, two challenges remain in this field: i) existing methods struggle to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuanmeng Zhang , Jianfeng Zhang , Rohan Chacko , Hongyi Xu , Guoxian Song , Yi Yang , Jiashi Feng

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy

Creating photorealistic 3D head avatars from limited input has become increasingly important for applications in virtual reality, telepresence, and digital entertainment. While recent advances like neural rendering and 3D Gaussian splatting…

Graphics · Computer Science 2026-03-12 Chen Guo , Zhuo Su , Liao Wang , Jian Wang , Shuang Li , Xu Chang , Zhaohu Li , Yang Zhao , Guidong Wang , Yebin Liu , Ruqi Huang