English
Related papers

Related papers: Human 3D Avatar Modeling with Implicit Neural Repr…

200 papers

As the digital and physical worlds become more intertwined, there has been a lot of interest in digital avatars that closely resemble their real-world counterparts. Current digitization methods used in 3D production pipelines require costly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yifan Wang , Ivan Molodetskikh , Ondrej Texler , Dimitar Dinev

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yang Hong , Bo Peng , Haiyao Xiao , Ligang Liu , Juyong Zhang

Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Baowen Zhang , Jiahe Li , Xiaoming Deng , Yinda Zhang , Cuixia Ma , Hongan Wang

It is now possible to reconstruct dynamic human motion and shape from a sparse set of cameras using Neural Radiance Fields (NeRF) driven by an underlying skeleton. However, a challenge remains to model the deformation of cloth and skin in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Chunjin Song , Bastian Wandt , Helge Rhodin

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

Neural representations have emerged as a new paradigm for applications in rendering, imaging, geometric modeling, and simulation. Compared to traditional representations such as meshes, point clouds, or volumes they can be flexibly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Julien N. P. Martel , David B. Lindell , Connor Z. Lin , Eric R. Chan , Marco Monteiro , Gordon Wetzstein

Implicit representations of 3D objects have recently achieved impressive results on learning-based 3D reconstruction tasks. While existing works use simple texture models to represent object appearance, photo-realistic image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Michael Oechsle , Michael Niemeyer , Lars Mescheder , Thilo Strauss , Andreas Geiger

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Recent advances in 3D human shape estimation build upon parametric representations that model very well the shape of the naked body, but are not appropriate to represent the clothing geometry. In this paper, we present an approach to model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Albert Pumarola , Jordi Sanchez , Gary P. T. Choi , Alberto Sanfeliu , Francesc Moreno-Noguer

Reconstructing photo-realistic drivable human avatars from multi-view image sequences has been a popular and challenging topic in the field of computer vision and graphics. While existing NeRF-based methods can achieve high-quality novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yujiao Jiang , Qingmin Liao , Xiaoyu Li , Li Ma , Qi Zhang , Chaopeng Zhang , Zongqing Lu , Ying Shan

Substantial progress has been made on modeling rigid 3D objects using deep implicit representations. Yet, extending these methods to learn neural models of human shape is still in its infancy. Human bodies are complex and the key challenge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Marko Mihajlovic , Yan Zhang , Michael J. Black , Siyu Tang

We present dynamic neural radiance fields for modeling the appearance and dynamics of a human face. Digitally modeling and reconstructing a talking human is a key building-block for a variety of applications. Especially, for telepresence…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Guy Gafni , Justus Thies , Michael Zollhöfer , Matthias Nießner

Estimating 3D human pose and shape from 2D images is a crucial yet challenging task. While prior methods with model-based representations can perform reasonably well on whole-body images, they often fail when parts of the body are occluded…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Chun-Han Yao , Jimei Yang , Duygu Ceylan , Yi Zhou , Yang Zhou , Ming-Hsuan Yang

In recent years, neural implicit representations have made remarkable progress in modeling of 3D shapes with arbitrary topology. In this work, we address two key limitations of such representations, in failing to capture local 3D geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yunlu Chen , Basura Fernando , Hakan Bilen , Matthias Nießner , Efstratios Gavves

Undoubtedly, high-fidelity 3D hair plays an indispensable role in digital humans. However, existing monocular hair modeling methods are either tricky to deploy in digital systems (e.g., due to their dependence on complex user interactions…

Graphics · Computer Science 2022-05-10 Keyu Wu , Yifan Ye , Lingchen Yang , Hongbo Fu , Kun Zhou , Youyi Zheng

We present PrismAvatar: a 3D head avatar model which is designed specifically to enable real-time animation and rendering on resource-constrained edge devices, while still enjoying the benefits of neural volumetric rendering at training…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Prashant Raina , Felix Taubner , Mathieu Tuli , Eu Wern Teh , Kevin Ferreira

Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Marc Habermann , Lingjie Liu , Weipeng Xu , Gerard Pons-Moll , Michael Zollhoefer , Christian Theobalt

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Methods allowing the synthesis of realistic cell shapes could help generate training data sets to improve cell tracking and segmentation in biomedical images. Deep generative models for cell shape synthesis require a light-weight and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 David Wiesner , Julian Suk , Sven Dummer , David Svoboda , Jelmer M. Wolterink

3D modeling of articulated objects is a research problem within computer vision, graphics, and robotics. Its objective is to understand the shape and motion of the articulated components, represent the geometry and mobility of object parts,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiayi Liu , Manolis Savva , Ali Mahdavi-Amiri