English
Related papers

Related papers: NPMs: Neural Parametric Models for 3D Deformable S…

200 papers

As a classic statistical model of 3D facial shape and texture, 3D Morphable Model (3DMM) is widely used in facial analysis, e.g., model fitting, image synthesis. Conventional 3DMM is learned from a set of well-controlled 2D face images with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Luan Tran , Xiaoming Liu

Due to the widespread use of complex machine learning models in real-world applications, it is becoming critical to explain model predictions. However, these models are typically black-box deep neural networks, explained post-hoc via…

Machine Learning · Computer Science 2022-10-20 Filip Radenovic , Abhimanyu Dubey , Dhruv Mahajan

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent spaces. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Simon Giebenhain , Tobias Kirschstein , Markos Georgopoulos , Martin Rünz , Lourdes Agapito , Matthias Nießner

We propose a novel method for learning representations of poses for 3D deformable objects, which specializes in 1) disentangling pose information from the object's identity, 2) facilitating the learning of pose variations, and 3)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Seungwoo Yoo , Juil Koo , Kyeongmin Yeo , Minhyuk Sung

3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xiangyu Zhu , Chang Yu , Di Huang , Zhen Lei , Hao Wang , Stan Z. Li

Parametric 3D body models like SMPL only represent minimally-clothed people and are hard to extend to clothing because they have a fixed mesh topology and resolution. To address these limitations, recent work uses implicit surfaces or point…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Qianli Ma , Jinlong Yang , Michael J. Black , Siyu Tang

Implicit functions represented as deep learning approximations are powerful for reconstructing 3D surfaces. However, they can only produce static surfaces that are not controllable, which provides limited ability to modify the resulting…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Bharat Lal Bhatnagar , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

Humans effortlessly infer the 3D shape of objects. What computations underlie this ability? Although various computational models have been proposed, none of them capture the human ability to match object shape across viewpoints. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Thomas P. O'Connell , Tyler Bonnen , Yoni Friedman , Ayush Tewari , Josh B. Tenenbaum , Vincent Sitzmann , Nancy Kanwisher

For 3D face modeling, the recently developed 3D-aware neural rendering methods are able to render photorealistic face images with arbitrary viewing directions. The training of the parametric controllable 3D-aware face models, however, still…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Peizhi Yan , Rabab K. Ward , Dan Wang , Qiang Tang , Shan Du

Human perception of 3D shapes goes beyond reconstructing them as a set of points or a composition of geometric primitives: we also effortlessly understand higher-level shape structure such as the repetition and reflective symmetry of object…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yonglong Tian , Andrew Luo , Xingyuan Sun , Kevin Ellis , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

Estimating 3D human poses only from a 2D human pose sequence is thoroughly explored in recent years. Yet, prior to this, no such work has attempted to unify 2D and 3D pose representations in the shared feature space. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zhenyu Zhang , Wenhao Chai , Zhongyu Jiang , Tian Ye , Mingli Song , Jenq-Neng Hwang , Gaoang Wang

This paper introduces a method for learning to generate line drawings from 3D models. Our architecture incorporates a differentiable module operating on geometric features of the 3D model, and an image-based module operating on view-based…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Difan Liu , Mohamed Nabail , Aaron Hertzmann , Evangelos Kalogerakis

3D shape editing is widely used in a range of applications such as movie production, computer games and computer aided design. It is also a popular research topic in computer graphics and computer vision. In past decades, researchers have…

Graphics · Computer Science 2021-03-03 Yu-Jie Yuan , Yu-Kun Lai , Tong Wu , Lin Gao , Ligang Liu

Statistical shape modeling is an important tool to characterize variation in anatomical morphology. Typical shapes of interest are measured using 3D imaging and a subsequent pipeline of registration, segmentation, and some extraction of…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Riddhish Bhalodia , Shireen Y. Elhabian , Ladislav Kavan , Ross T. Whitaker

3D Morphable Models (3DMMs) are statistical models that represent facial texture and shape variations using a set of linear bases and more particular Principal Component Analysis (PCA). 3DMMs were used as statistical priors for…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yuxiang Zhou , Jiankang Deng , Irene Kotsia , Stefanos Zafeiriou

We present a self-supervised method to learn dynamic 3D deformations of garments worn by parametric human bodies. State-of-the-art data-driven approaches to model 3D garment deformations are trained using supervised strategies that require…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Igor Santesteban , Miguel A. Otaduy , Dan Casas

In this paper, we tackle the problem of 3D human shape estimation from single RGB images. While the recent progress in convolutional neural networks has allowed impressive results for 3D human pose estimation, estimating the full 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Valentin Gabeur , Jean-Sebastien Franco , Xavier Martin , Cordelia Schmid , Gregory Rogez

Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Baixin Xu , Jiarui Zhang , Kwan-Yee Lin , Chen Qian , Ying He

In this paper, we introduce Neural-ABC, a novel parametric model based on neural implicit functions that can represent clothed human bodies with disentangled latent spaces for identity, clothing, shape, and pose. Traditional mesh-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Honghu Chen , Yuxin Yao , Juyong Zhang