English
Related papers

Related papers: Relightable and Animatable Neural Avatar from Spar…

200 papers

Video-based human motion transfer creates video animations of humans following a source motion. Current methods show remarkable results for tightly-clad subjects. However, the lack of temporally consistent handling of plausible clothing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Moritz Kappel , Vladislav Golyanik , Mohamed Elgharib , Jann-Ole Henningson , Hans-Peter Seidel , Susana Castillo , Christian Theobalt , Marcus Magnor

Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Baixin Xu , Jiarui Zhang , Kwan-Yee Lin , Chen Qian , Ying He

Reconstructing 3D clothed human avatars from single images is a challenging task, especially when encountering complex poses and loose clothing. Current methods exhibit limitations in performance, largely attributable to their dependence on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zechuan Zhang , Li Sun , Zongxin Yang , Ling Chen , Yi Yang

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Imitation Learning from monocular video demonstrations provides a scalable approach for teaching complex skills to humanoid robots. However, translating human motion to humanoids requires overcoming significant morphological mismatches.…

In this paper, we propose Generalizable and Animatable Gaussian head Avatar (GAGAvatar) for one-shot animatable head avatar reconstruction. Existing methods rely on neural radiance fields, leading to heavy rendering consumption and low…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xuangeng Chu , Tatsuya Harada

In this paper, we propose a novel framework, Tracking-free Relightable Avatar (TRAvatar), for capturing and reconstructing high-fidelity 3D avatars. Compared to previous methods, TRAvatar works in a more practical and efficient setting.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Haotian Yang , Mingwu Zheng , Wanquan Feng , Haibin Huang , Yu-Kun Lai , Pengfei Wan , Zhongyuan Wang , Chongyang Ma

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

Holistic 3D human-scene reconstruction is a crucial and emerging research area in robot perception. A key challenge in holistic 3D human-scene reconstruction is to generate a physically plausible 3D scene from a single monocular RGB image.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Sandika Biswas , Kejie Li , Biplab Banerjee , Subhasis Chaudhuri , Hamid Rezatofighi

The ability to animate photo-realistic head avatars reconstructed from monocular portrait video sequences represents a crucial step in bridging the gap between the virtual and real worlds. Recent advancements in head avatar techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yufan Chen , Lizhen Wang , Qijing Li , Hongjiang Xiao , Shengping Zhang , Hongxun Yao , Yebin Liu

Reconstructing animatable 3D humans from casually captured images of articulated subjects without camera or pose information is highly practical but remains challenging due to view misalignment, occlusions, and the absence of structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lingteng Qiu , Peihao Li , Heyuan Li , Qi Zuo , Xiaodong Gu , Yuan Dong , Weihao Yuan , Rui Peng , Siyu Zhu , Xiaoguang Han , Guanying Chen , Zilong Dong

We present a method for recovering the shape and radiance of a scene consisting of multiple people given solely a few images. Multi-human scenes are complex due to additional occlusion and clutter. For single-human settings, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Qian li , Victoria Fernàndez Abrevaya , Franck Multon , Adnane Boukhayma

Reconstructing human dynamic vision from brain activity is a challenging task with great scientific significance. Although prior video reconstruction methods have made substantial progress, they still suffer from several limitations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yizhuo Lu , Changde Du , Chong Wang , Xuanliu Zhu , Liuyun Jiang , Xujin Li , Huiguang He

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optimizing both the shape…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chunyu Li , Taisuke Hashimoto , Eiichi Matsumoto , Hiroharu Kato

We present the first marker-less approach for temporally coherent 3D performance capture of a human with general clothing from monocular video. Our approach reconstructs articulated human skeleton motion as well as medium-scale non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Weipeng Xu , Avishek Chatterjee , Michael Zollhöfer , Helge Rhodin , Dushyant Mehta , Hans-Peter Seidel , Christian Theobalt

In high-end visual effects pipelines, a customized (and expensive) light stage system is (typically) used to scan an actor in order to acquire both geometry and texture for various expressions. Aiming towards democratization, we propose a…

Graphics · Computer Science 2024-01-31 Yilin Zhu , Dalton Omens , Haodi He , Ron Fedkiw

Recently, Transformer-based image restoration networks have achieved promising improvements over convolutional neural networks due to parameter-independent global interactions. To lower computational cost, existing works generally limit…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Jiale Zhang , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

We present a CloseUpAvatar - a novel approach for articulated human avatar representation dealing with more general camera motions, while preserving rendering quality for close-up views. CloseUpAvatar represents an avatar as a set of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 David Svitov , Pietro Morerio , Lourdes Agapito , Alessio Del Bue

3D reconstruction of dynamic scenes is a long-standing problem in computer graphics and increasingly difficult the less information is available. Shape-from-Template (SfT) methods aim to reconstruct a template-based geometry from RGB images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 David Stotko , Nils Wandel , Reinhard Klein

We present a method to reconstruct time-consistent human body models from monocular videos, focusing on extremely loose clothing or handheld object interactions. Prior work in human reconstruction is either limited to tight clothing with no…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jeff Tan , Donglai Xiang , Shubham Tulsiani , Deva Ramanan , Gengshan Yang