English
Related papers

Related papers: Synthetic Prior for Few-Shot Drivable Head Avatar …

200 papers

NeRFs have enabled highly realistic synthesis of human faces including complex appearance and reflectance effects of hair and skin. These methods typically require a large number of multi-view input images, making the process hardware…

We propose a method for synthesizing photo-realistic digital avatars from only one portrait as the reference. Given a portrait, our method synthesizes a coarse talking head video using driving keypoints features. And with the coarse video,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Shaoxu Li

As for human avatar reconstruction, contemporary techniques commonly necessitate the acquisition of costly data and struggle to achieve satisfactory results from a small number of casual images. In this paper, we investigate this task from…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xihe Yang , Xingyu Chen , Daiheng Gao , Shaohui Wang , Xiaoguang Han , Baoyuan Wang

Creating a 360{\deg} parametric model of a human head is a very challenging task. While recent advancements have demonstrated the efficacy of leveraging synthetic data for building such parametric head models, their performance remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yuxiao He , Yiyu Zhuang , Yanwen Wang , Yao Yao , Siyu Zhu , Xiaoyu Li , Qi Zhang , Xun Cao , Hao Zhu

We present a novel approach for 3D hair reconstruction from single photographs based on a global hair prior combined with local optimization. Capturing strand-based hair geometry from single photographs is challenging due to the variety and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Vanessa Sklyarova , Egor Zakharov , Malte Prinzler , Giorgio Becherini , Michael J. Black , Justus Thies

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

We introduce ELITE, an Efficient Gaussian head avatar synthesis from a monocular video via Learned Initialization and TEst-time generative adaptation. Prior works rely either on a 3D data prior or a 2D generative prior to compensate for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Kim Youwang , Lee Hyoseok , Subin Park , Gerard Pons-Moll , Tae-Hyun Oh

We present FaceLift, a novel feed-forward approach for generalizable high-quality 360-degree 3D head reconstruction from a single image. Our pipeline first employs a multi-view latent diffusion model to generate consistent side and back…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Weijie Lyu , Yi Zhou , Ming-Hsuan Yang , Zhixin Shu

We present DiffPortrait3D, a conditional diffusion model that is capable of synthesizing 3D-consistent photo-realistic novel views from as few as a single in-the-wild portrait. Specifically, given a single RGB input, we aim to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuming Gu , You Xie , Hongyi Xu , Guoxian Song , Yichun Shi , Di Chang , Jing Yang , Linjie Luo

Few-shot object detection aims to simultaneously localize and classify the objects in an image with limited training samples. However, most existing few-shot object detection methods focus on extracting the features of a few samples of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Anh-Khoa Nguyen Vu , Thanh-Toan Do , Vinh-Tiep Nguyen , Tam Le , Minh-Triet Tran , Tam V. Nguyen

We introduce FactorPortrait, a video diffusion method for controllable portrait animation that enables lifelike synthesis from disentangled control signals of facial expressions, head movement, and camera viewpoints. Given a single portrait…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jiapeng Tang , Kai Li , Chengxiang Yin , Liuhao Ge , Fei Jiang , Jiu Xu , Matthias Nießner , Christian Häne , Timur Bagautdinov , Egor Zakharov , Peihong Guo

Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion methods to project a real image into the generator's latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fei Yin , Yong Zhang , Xuan Wang , Tengfei Wang , Xiaoyu Li , Yuan Gong , Yanbo Fan , Xiaodong Cun , Ying Shan , Cengiz Oztireli , Yujiu Yang

We introduce FlexAvatar, a method for creating high-quality and complete 3D head avatars from a single image. A core challenge lies in the limited availability of multi-view data and the tendency of monocular training to yield incomplete 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Tobias Kirschstein , Simon Giebenhain , Matthias Nießner

Real-time rendering of human head avatars is a cornerstone of many computer graphics applications, such as augmented reality, video games, and films, to name a few. Recent approaches address this challenge with computationally efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Kartik Teotia , Hyeongwoo Kim , Pablo Garrido , Marc Habermann , Mohamed Elgharib , Christian Theobalt

Controllability, generalizability and efficiency are the major objectives of constructing face avatars represented by neural implicit field. However, existing methods have not managed to accommodate the three requirements simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zhiyuan Ma , Xiangyu Zhu , Guojun Qi , Zhen Lei , Lei Zhang

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

The human visual system has the remarkably ability to be able to effortlessly learn novel concepts from only a few examples. Mimicking the same behavior on machine learning vision systems is an interesting and very challenging research…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Spyros Gidaris , Nikos Komodakis

Despite recent progress in 3D Gaussian-based head avatar modeling, efficiently generating high fidelity avatars remains a challenge. Current methods typically rely on extensive multi-view capture setups or monocular videos with per-identity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xinya Ji , Sebastian Weiss , Manuel Kansy , Jacek Naruniec , Xun Cao , Barbara Solenthaler , Derek Bradley

Building 3D animatable head avatars from a single image is an important yet challenging problem. Existing methods generally collapse under large camera pose variations, compromising the realism of 3D avatars. In this work, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shuling Zhao , Dan Xu