English
Related papers

Related papers: One2Avatar: Generative Implicit Head Avatar For Fe…

200 papers

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

Identity preserving editing of faces is a generative task that enables modifying the illumination, adding/removing eyeglasses, face aging, editing hairstyles, modifying expression etc., while preserving the identity of the face. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Vishal Vinod

We present a novel method for high detail-preserving human avatar creation from monocular video. A parameterized body model is refined and optimized to maximally resemble subjects from a video showing them from all sides. Our avatars…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

Traditionally, creating photo-realistic 3D head avatars requires a studio-level multi-view capture setup and expensive optimization during test-time, limiting the use of digital human doubles to the VFX industry or offline renderings. To…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tobias Kirschstein , Javier Romero , Artem Sevastopolsky , Matthias Nießner , Shunsuke Saito

Animatable head avatar generation typically requires extensive data for training. To reduce the data requirements, a natural solution is to leverage existing data-free static avatar generation methods, such as pre-trained diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zhenglin Zhou , Fan Ma , Hehe Fan , Tat-Seng Chua

Audio to Video generation is an interesting problem that has numerous applications across industry verticals including film making, multi-media, marketing, education and others. High-quality video generation with expressive facial movements…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Neeraj Kumar , Srishti Goel , Ankur Narang , Mujtaba Hasan

Text-to-Avatar generation has recently made significant strides due to advancements in diffusion models. However, most existing work remains constrained by limited diversity, producing avatars with subtle differences in appearance for a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Weijing Tao , Biwen Lei , Kunhao Liu , Shijian Lu , Miaomiao Cui , Xuansong Xie , Chunyan Miao

Generating realistic talking faces is an interesting and long-standing topic in the field of computer vision. Although significant progress has been made, it is still challenging to generate high-quality dynamic faces with personalized…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Bo Ding , Zhenfeng Fan , Shuang Yang , Shihong Xia

Reconstructing photorealistic and dynamic portrait avatars from images is essential to many applications including advertising, visual effects, and virtual reality. Depending on the application, avatar reconstruction involves different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Felix Taubner , Ruihang Zhang , Mathieu Tuli , David B. Lindell

We introduce a novel framework for 3D human avatar generation and personalization, leveraging text prompts to enhance user engagement and customization. Central to our approach are key innovations aimed at overcoming the challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Armand Comas-Massagué , Di Qiu , Menglei Chai , Marcel Bühler , Amit Raj , Ruiqi Gao , Qiangeng Xu , Mark Matthews , Paulo Gotardo , Octavia Camps , Sergio Orts-Escolano , Thabo Beeler

Generating animatable human avatars from a single image is essential for various digital human modeling applications. Existing 3D reconstruction methods often struggle to capture fine details in animatable models, while generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Lingteng Qiu , Shenhao Zhu , Qi Zuo , Xiaodong Gu , Yuan Dong , Junfei Zhang , Chao Xu , Zhe Li , Weihao Yuan , Liefeng Bo , Guanying Chen , Zilong Dong

Reconstructing a complete 3D head from a single portrait remains challenging because existing methods still face a sharp quality-speed trade-off: high-fidelity pipelines often rely on multi-stage processing and per-subject optimization,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yujie Gao , Yao Xiao , Xiangnan Zhu , Ya Li , Yiyi Zhang , Liqing Zhang , Jianfu Zhang

Realistic and diverse 3D shape generation is helpful for a wide variety of applications such as virtual reality, gaming, and animation. Modern generative models, such as GANs and diffusion models, learn from large-scale datasets and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Digital human avatars aim to simulate the dynamic appearance of humans in virtual environments, enabling immersive experiences across gaming, film, virtual reality, and more. However, the conventional process for creating and animating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Felix Taubner , Ruihang Zhang , Mathieu Tuli , Sherwin Bahmani , David B. Lindell

Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiyi Chen , Marko Mihajlovic , Shaofei Wang , Sergey Prokudin , Siyu Tang

Despite recent progress in 3D Gaussian-based head avatar modeling, efficiently generating high fidelity avatars remains a challenge. Current methods typically rely on extensive multi-view capture setups or monocular videos with per-identity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xinya Ji , Sebastian Weiss , Manuel Kansy , Jacek Naruniec , Xun Cao , Barbara Solenthaler , Derek Bradley

One-shot 3D talking portrait generation aims to reconstruct a 3D avatar from an unseen image, and then animate it with a reference video or audio to generate a talking portrait video. The existing methods fail to simultaneously achieve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhenhui Ye , Tianyun Zhong , Yi Ren , Jiaqi Yang , Weichuang Li , Jiawei Huang , Ziyue Jiang , Jinzheng He , Rongjie Huang , Jinglin Liu , Chen Zhang , Xiang Yin , Zejun Ma , Zhou Zhao

We introduce an approach that creates animatable human avatars from monocular videos using 3D Gaussian Splatting (3DGS). Existing methods based on neural radiance fields (NeRFs) achieve high-quality novel-view/novel-pose image synthesis but…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Zhiyin Qian , Shaofei Wang , Marko Mihajlovic , Andreas Geiger , Siyu Tang

Reconstructing personalized animatable head avatars has significant implications in the fields of AR/VR. Existing methods for achieving explicit face control of 3D Morphable Models (3DMM) typically rely on multi-view images or videos of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Haoyu Ma , Tong Zhang , Shanlin Sun , Xiangyi Yan , Kun Han , Xiaohui Xie

Photorealistic 3D head avatars are vital for telepresence, gaming, and VR. However, most methods focus solely on facial regions, ignoring natural hand-face interactions, such as a hand resting on the chin or fingers gently touching the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Haonan He , Yufeng Zheng , Jie Song