English
Related papers

Related papers: Human 3D Avatar Modeling with Implicit Neural Repr…

200 papers

Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these…

Graphics · Computer Science 2023-06-27 Yanran Guan , Andrei Chubarau , Ruby Rao , Derek Nowrouzezahrai

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Marko Mihajlovic , Shunsuke Saito , Aayush Bansal , Michael Zollhoefer , Siyu Tang

Personalised 3D vascular models are valuable for diagnosis, prognosis and treatment planning in patients with cardiovascular disease. Traditionally, such models have been constructed with explicit representations such as meshes and voxel…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Dieuwertje Alblas , Christoph Brune , Kak Khee Yeung , Jelmer M. Wolterink

Active soft bodies can affect their shape through an internal actuation mechanism that induces a deformation. Similar to recent work, this paper utilizes a differentiable, quasi-static, and physics-based simulation layer to optimize for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Lingchen Yang , Byungsoo Kim , Gaspard Zoss , Baran Gözcü , Markus Gross , Barbara Solenthaler

We propose Neural Deformable Fields (NDF), a new representation for dynamic human digitization from a multi-view video. Recent works proposed to represent a dynamic human body with shared canonical neural radiance fields which links to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ruiqi Zhang , Jie Chen

We present a novel pipeline for learning high-quality triangular human avatars from multi-view videos. Recent methods for avatar learning are typically based on neural radiance fields (NeRF), which is not compatible with traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yushuo Chen , Zerong Zheng , Zhe Li , Chao Xu , Yebin Liu

Direct prediction of 3D body pose and shape remains a challenge even for highly parameterized deep learning models. Mapping from the 2D image space to the prediction space is difficult: perspective ambiguities make the loss function noisy…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Mohamed Omran , Christoph Lassner , Gerard Pons-Moll , Peter V. Gehler , Bernt Schiele

Neural fields such as implicit surfaces have recently enabled avatar modeling from raw scans without explicit temporal correspondences. In this work, we exploit autoregressive modeling to further extend this notion to capture dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Ziqian Bai , Timur Bagautdinov , Javier Romero , Michael Zollhöfer , Ping Tan , Shunsuke Saito

We propose a novel neural architecture for representing 3D surfaces, which harnesses two complementary shape representations: (i) an explicit representation via an atlas, i.e., embeddings of 2D domains into 3D; (ii) an implicit-function…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Matthew Fisher , Noam Aigerman , Vladimir G. Kim

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

Human shape estimation is an important task for video editing, animation and fashion industry. Predicting 3D human body shape from natural images, however, is highly challenging due to factors such as variation in human bodies, clothing and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Gül Varol , Duygu Ceylan , Bryan Russell , Jimei Yang , Ersin Yumer , Ivan Laptev , Cordelia Schmid

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

Human motion capture either requires multi-camera systems or is unreliable when using single-view input due to depth ambiguities. Meanwhile, mirrors are readily available in urban environments and form an affordable alternative by recording…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Daniel Ajisafe , James Tang , Shih-Yang Su , Bastian Wandt , Helge Rhodin

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

3D head avatars built with neural implicit volumetric representations have achieved unprecedented levels of photorealism. However, the computational cost of these methods remains a significant barrier to their widespread adoption,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Ziqian Bai , Feitong Tan , Sean Fanello , Rohit Pandey , Mingsong Dou , Shichen Liu , Ping Tan , Yinda Zhang

Realistic face rendering from multi-view images is beneficial to various computer vision and graphics applications. Due to the complex spatially-varying reflectance properties and geometry characteristics of faces, however, it remains…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Mingwu Zheng , Haiyu Zhang , Hongyu Yang , Di Huang