English
Related papers

Related papers: R3-Avatar: Record and Retrieve Temporal Codebook f…

200 papers

High-fidelity reconstruction of head avatars from monocular videos is highly desirable for virtual human applications, but it remains a challenge in the fields of computer graphics and computer vision. In this paper, we propose a two-phase…

Graphics · Computer Science 2025-03-31 Pilseo Park , Ze Zhang , Michel Sarkis , Ning Bi , Xiaoming Liu , Yiying Tong

While progress in 2D generative models of human appearance has been rapid, many applications require 3D avatars that can be animated and rendered. Unfortunately, most existing methods for learning generative models of 3D humans with diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Zijian Dong , Xu Chen , Jinlong Yang , Michael J. Black , Otmar Hilliges , Andreas Geiger

Photorealistic 3D head avatars are vital for telepresence, gaming, and VR. However, most methods focus solely on facial regions, ignoring natural hand-face interactions, such as a hand resting on the chin or fingers gently touching the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Haonan He , Yufeng Zheng , Jie Song

Fast 3D clothed human reconstruction from monocular video remains a significant challenge in computer vision, particularly in balancing computational efficiency with reconstruction quality. Current approaches are either focused on static…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Matthew Marchellus , Nadhira Noor , In Kyu Park

Reconstructing animatable and high-quality 3D head avatars from monocular videos, especially with realistic relighting, is a valuable task. However, the limited information from single-view input, combined with the complex head poses and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Dongbin Zhang , Yunfei Liu , Lijian Lin , Ye Zhu , Kangjie Chen , Minghan Qin , Yu Li , Haoqian Wang

We present a novel method for high detail-preserving human avatar creation from monocular video. A parameterized body model is refined and optimized to maximally resemble subjects from a video showing them from all sides. Our avatars…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Marc Habermann , Lingjie Liu , Weipeng Xu , Gerard Pons-Moll , Michael Zollhoefer , Christian Theobalt

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

We present a unified framework for reconstructing animatable 3D human avatars from a single portrait across head, half-body, and full-body inputs. Our method tackles three bottlenecks: pose- and framing-sensitive feature representations,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jiawei Zhang , Lei Chu , Jiahao Li , Zhenyu Zang , Chong Li , Xiao Li , Xun Cao , Hao Zhu , Yan Lu

We present FlexAvatar, a flexible large reconstruction model for high-fidelity 3D head avatars with detailed dynamic deformation from single or sparse images, without requiring camera poses or expression labels. It leverages a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Cheng Peng , Zhuo Su , Liao Wang , Chen Guo , Zhaohu Li , Chengjiang Long , Zheng Lv , Jingxiang Sun , Chenyangguang Zhang , Yebin Liu

We propose 360{\deg} Volumetric Portrait (3VP) Avatar, a novel method for reconstructing 360{\deg} photo-realistic portrait avatars of human subjects solely based on monocular video inputs. State-of-the-art monocular avatar reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Jalees Nehvi , Berna Kabadayi , Julien Valentin , Justus Thies

We present GaussianAvatar, an efficient approach to creating realistic human avatars with dynamic 3D appearances from a single video. We start by introducing animatable 3D Gaussians to explicitly represent humans in various poses and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Liangxiao Hu , Hongwen Zhang , Yuxiang Zhang , Boyao Zhou , Boning Liu , Shengping Zhang , Liqiang Nie

Reconstructing 3D clothed human avatars from single images is a challenging task, especially when encountering complex poses and loose clothing. Current methods exhibit limitations in performance, largely attributable to their dependence on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zechuan Zhang , Li Sun , Zongxin Yang , Ling Chen , Yi Yang

With NeRF widely used for facial reenactment, recent methods can recover photo-realistic 3D head avatar from just a monocular video. Unfortunately, the training process of the NeRF-based methods is quite time-consuming, as MLP used in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Yuelang Xu , Lizhen Wang , Xiaochen Zhao , Hongwen Zhang , Yebin Liu

Much progress has been made in reconstructing garments from an image or a video. However, none of existing works meet the expectations of digitizing high-quality animatable dynamic garments that can be adjusted to various unseen poses. In…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Xiongzheng Li , Jinsong Zhang , Yu-Kun Lai , Jingyu Yang , Kun Li

The trend in sign language generation is centered around data-driven generative methods that require vast amounts of precise 2D and 3D human pose data to achieve an acceptable generation quality. However, currently, most sign language…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Kaustubh Kundu , Hrishav Bakul Barua , Lucy Robertson-Bell , Zhixi Cai , Kalin Stefanov

Neural radiance fields are capable of reconstructing high-quality drivable human avatars but are expensive to train and render and not suitable for multi-human scenes with complex shadows. To reduce consumption, we propose Animatable 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yang Liu , Xiang Huang , Minghan Qin , Qinwei Lin , Haoqian Wang

This paper presents an algorithm to reconstruct temporally consistent 3D meshes of deformable object instances from videos in the wild. Without requiring annotations of 3D mesh, 2D keypoints, or camera pose for each video frame, we pose…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Xueting Li , Sifei Liu , Shalini De Mello , Kihwan Kim , Xiaolong Wang , Ming-Hsuan Yang , Jan Kautz

Over the past years, significant progress has been made in creating photorealistic and drivable 3D avatars solely from videos of real humans. However, a core remaining challenge is the fine-grained and user-friendly editing of clothing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Basavaraj Sunagad , Heming Zhu , Mohit Mendiratta , Adam Kortylewski , Christian Theobalt , Marc Habermann