English
Related papers

Related papers: Detailed Human Avatars from Monocular Video

200 papers

Creating photorealistic avatars for individuals traditionally involves extensive capture sessions with complex and expensive studio devices like the LightStage system. While recent strides in neural representations have enabled the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 ShahRukh Athar , Shunsuke Saito , Zhengyu Yang , Stanislav Pidhorsky , Chen Cao

The creation of 3D human avatars from multi-view videos is a significant yet challenging task in computer vision. However, existing techniques rely on high-quality, sharp images as input, which are often impractical to obtain in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Muyao Niu , Yifan Zhan , Qingtian Zhu , Zhuoxiao Li , Wei Wang , Zhihang Zhong , Xiao Sun , Yinqiang Zheng

While recent 3D head avatar creation methods attempt to animate facial dynamics, they often fail to capture personalized details, limiting realism and expressiveness. To fill this gap, we present DipGuava (Disentangled and Personalized…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jeonghaeng Lee , Seok Keun Choi , Zhixuan Li , Weisi Lin , Sanghoon Lee

We present a novel pipeline for learning high-quality triangular human avatars from multi-view videos. Recent methods for avatar learning are typically based on neural radiance fields (NeRF), which is not compatible with traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yushuo Chen , Zerong Zheng , Zhe Li , Chao Xu , Yebin Liu

Nuanced expressiveness, particularly through fine-grained hand and facial expressions, is pivotal for enhancing the realism and vitality of digital human representations. In this work, we focus on investigating the expressiveness of human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Hezhen Hu , Zhiwen Fan , Tianhao Wu , Yihan Xi , Seoyoung Lee , Georgios Pavlakos , Zhangyang Wang

We introduce a new method that generates photo-realistic humans under novel views and poses given a monocular video as input. Despite the significant progress recently on this topic, with several methods exploring shared canonical neural…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Tiantian Wang , Nikolaos Sarafianos , Ming-Hsuan Yang , Tony Tung

We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g. a video from YouTube. Our method enables pausing the video at any frame and rendering the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Chung-Yi Weng , Brian Curless , Pratul P. Srinivasan , Jonathan T. Barron , Ira Kemelmacher-Shlizerman

The ability to animate photo-realistic head avatars reconstructed from monocular portrait video sequences represents a crucial step in bridging the gap between the virtual and real worlds. Recent advancements in head avatar techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yufan Chen , Lizhen Wang , Qijing Li , Hongjiang Xiao , Shengping Zhang , Hongxun Yao , Yebin Liu

We present HARP (HAnd Reconstruction and Personalization), a personalized hand avatar creation approach that takes a short monocular RGB video of a human hand as input and reconstructs a faithful hand avatar exhibiting a high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Korrawe Karunratanakul , Sergey Prokudin , Otmar Hilliges , Siyu Tang

Traditional methods for constructing high-quality, personalized head avatars from monocular videos demand extensive face captures and training time, posing a significant challenge for scalability. This paper introduces a novel approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Zhixuan Yu , Ziqian Bai , Abhimitra Meka , Feitong Tan , Qiangeng Xu , Rohit Pandey , Sean Fanello , Hyun Soo Park , Yinda Zhang

We present the first approach to volumetric performance capture and novel-view rendering at real-time speed from monocular video, eliminating the need for expensive multi-view systems or cumbersome pre-acquisition of a personalized template…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Ruilong Li , Yuliang Xiu , Shunsuke Saito , Zeng Huang , Kyle Olszewski , Hao Li

Rendering the visual appearance of moving humans from occluded monocular videos is a challenging task. Most existing research renders 3D humans under ideal conditions, requiring a clear and unobstructed scene. Those methods cannot be used…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Tiange Xiang , Adam Sun , Scott Delp , Kazuki Kozuka , Li Fei-Fei , Ehsan Adeli

Human avatar has become a novel type of 3D asset with various applications. Ideally, a human avatar should be fully customizable to accommodate different settings and environments. In this work, we introduce NECA, an approach capable of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Junjin Xiao , Qing Zhang , Zhan Xu , Wei-Shi Zheng

Head avatar reenactment focuses on creating animatable personal avatars from monocular videos, serving as a foundational element for applications like social signal understanding, gaming, human-machine interaction, and computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Wei Liang , Hui Yu , Derui Ding , Rachael E. Jack , Philippe G. Schyns

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Animating virtual avatars with free-view control is crucial for various applications like virtual reality and digital entertainment. Previous studies have attempted to utilize the representation power of the neural radiance field (NeRF) to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhengming Yu , Wei Cheng , Xian Liu , Wayne Wu , Kwan-Yee Lin

We present a method to build animatable dog avatars from monocular videos. This is challenging as animals display a range of (unpredictable) non-rigid movements and have a variety of appearance details (e.g., fur, spots, tails). We develop…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Remy Sabathier , Niloy J. Mitra , David Novotny

We propose a new type of full-body human avatars, which combines parametric mesh-based body model with a neural texture. We show that with the help of neural textures, such avatars can successfully model clothing and hair, which usually…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Artur Grigorev , Karim Iskakov , Anastasia Ianina , Renat Bashirov , Ilya Zakharkin , Alexander Vakhitov , Victor Lempitsky

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

Reconstructing high-fidelity animatable human avatars from monocular videos remains challenging due to insufficient geometric information in single-view observations. While recent 3D Gaussian Splatting methods have shown promise, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jinlong Fan , Bingyu Hu , Xingguang Li , Yuxiang Yang , Jing Zhang