English
Related papers

Related papers: Generalizable One-shot Neural Head Avatar

200 papers

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

Recent years have witnessed considerable achievements in facial avatar reconstruction with neural volume rendering. Despite notable advancements, the reconstruction of complex and dynamic head movements from monocular videos still suffers…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Luchuan Song , Pinxin Liu , Lele Chen , Guojun Yin , Chenliang Xu

Animating various character drawings is an engaging visual content creation task. Given a single character drawing, existing animation methods are limited to flat 2D motions and thus lack 3D effects. An alternative solution is to…

Graphics · Computer Science 2024-09-16 Jie Zhou , Chufeng Xiao , Miu-Ling Lam , Hongbo Fu

Despite significant progress in 3D avatar reconstruction, it still faces challenges such as high time complexity, sensitivity to data quality, and low data utilization. We propose FastAvatar, a feedforward 3D avatar framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yue Wu , Xuanhong Chen , Yufan Wu , Wen Li , Yuxi Lu , Kairui Feng

We study the problem of creating a character model that can be controlled in real time from a single image of an anime character. A solution to this problem would greatly reduce the cost of creating avatars, computer games, and other…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Pramook Khungurn

We introduce an approach that creates animatable human avatars from monocular videos using 3D Gaussian Splatting (3DGS). Existing methods based on neural radiance fields (NeRFs) achieve high-quality novel-view/novel-pose image synthesis but…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Zhiyin Qian , Shaofei Wang , Marko Mihajlovic , Andreas Geiger , Siyu Tang

3D-aware face generators are typically trained on 2D real-life face image datasets that primarily consist of near-frontal face data, and as such, they are unable to construct one-quarter headshot 3D portraits with complete head, neck, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yiqian Wu , Hao Xu , Xiangjun Tang , Yue Shangguan , Hongbo Fu , Xiaogang Jin

Creating animatable 3D avatars from a single image remains challenging due to style limitations (realistic, cartoon, anime) and difficulties in handling accessories or hairstyles. While 3D diffusion models advance single-view reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Tingting Liao , Yujian Zheng , Adilbek Karmanov , Liwen Hu , Leyang Jin , Yuliang Xiu , Hao Li

We introduce TurboPortrait3D: a method for low-latency novel-view synthesis of human portraits. Our approach builds on the observation that existing image-to-3D models for portrait generation, while capable of producing renderable 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Emily Kim , Julieta Martinez , Timur Bagautdinov , Jessica Hodgins

Recent learning approaches that implicitly represent surface geometry using coordinate-based neural representations have shown impressive results in the problem of multi-view 3D reconstruction. The effectiveness of these techniques is,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Eduard Ramon , Gil Triginer , Janna Escur , Albert Pumarola , Jaime Garcia , Xavier Giro-i-Nieto , Francesc Moreno-Noguer

Existing full-body Gaussian avatar methods primarily optimize global reconstruction quality and often fail to preserve fine-grained facial geometry and expression details. This challenge arises from limited facial representational capacity…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Willem Menu , Erkut Akdag , Pedro Quesado , Yasaman Kashefbahrami , Egor Bondarev

Inspired by the effectiveness of 3D Gaussian Splatting (3DGS) in reconstructing detailed 3D scenes within multi-view setups and the emergence of large 2D human foundation models, we introduce Arc2Avatar, the first SDS-based method utilizing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Dimitrios Gerogiannis , Foivos Paraperas Papantoniou , Rolandos Alexandros Potamias , Alexandros Lattas , Stefanos Zafeiriou

Despite progress in human motion capture, existing multi-view methods often face challenges in estimating the 3D pose and shape of multiple closely interacting people. This difficulty arises from reliance on accurate 2D joint estimations,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Feichi Lu , Zijian Dong , Jie Song , Otmar Hilliges

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruihe Wang , Yukang Cao , Kai Han , Kwan-Yee K. Wong

We introduce 3D Gaussian blendshapes for modeling photorealistic head avatars. Taking a monocular video as input, we learn a base head model of neutral expression, along with a group of expression blendshapes, each of which corresponds to a…

Graphics · Computer Science 2024-05-03 Shengjie Ma , Yanlin Weng , Tianjia Shao , Kun Zhou

Hair plays a significant role in personal identity and appearance, making it an essential component of high-quality, photorealistic avatars. Existing approaches either focus on modeling the facial region only or rely on personalized models,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ziyan Wang , Giljoo Nam , Aljaz Bozic , Chen Cao , Jason Saragih , Michael Zollhoefer , Jessica Hodgins

As for human avatar reconstruction, contemporary techniques commonly necessitate the acquisition of costly data and struggle to achieve satisfactory results from a small number of casual images. In this paper, we investigate this task from…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xihe Yang , Xingyu Chen , Daiheng Gao , Shaohui Wang , Xiaoguang Han , Baoyuan Wang

3D Gaussian Splatting (3DGS) has become a standard approach to reconstruct and render photorealistic 3D head avatars. A major challenge is to relight the avatars to match any scene illumination. For high quality relighting, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yingyan Xu , Pramod Rao , Sebastian Weiss , Gaspard Zoss , Markus Gross , Christian Theobalt , Marc Habermann , Derek Bradley

We introduce Structured 3D Features, a model based on a novel implicit 3D representation that pools pixel-aligned image features onto dense 3D points sampled from a parametric, statistical human mesh surface. The 3D points have associated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Enric Corona , Mihai Zanfir , Thiemo Alldieck , Eduard Gabriel Bazavan , Andrei Zanfir , Cristian Sminchisescu