English
Related papers

Related papers: Implicit Neural Head Synthesis via Controllable Lo…

200 papers

Neural fields have emerged as a powerful representation for 3D geometry, enabling compact and continuous modeling of complex shapes. Despite their expressive power, manipulating neural fields in a controlled and accurate manner --…

Graphics · Computer Science 2025-09-30 Daniele Baieri , Filippo Maggioli , Emanuele Rodolà , Simone Melzi , Zorah Lähner

A human 3D avatar is one of the important elements in the metaverse, and the modeling effect directly affects people's visual experience. However, the human body has a complex topology and diverse details, so it is often expensive,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Mingyang Sun , Dingkang Yang , Dongliang Kou , Yang Jiang , Weihua Shan , Zhe Yan , Lihua Zhang

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent spaces. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Simon Giebenhain , Tobias Kirschstein , Markos Georgopoulos , Martin Rünz , Lourdes Agapito , Matthias Nießner

The ability to create realistic, animatable and relightable head avatars from casual video sequences would open up wide ranging applications in communication and entertainment. Current methods either build on explicit 3D morphable meshes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yufeng Zheng , Wang Yifan , Gordon Wetzstein , Michael J. Black , Otmar Hilliges

We present dynamic neural radiance fields for modeling the appearance and dynamics of a human face. Digitally modeling and reconstructing a talking human is a key building-block for a variety of applications. Especially, for telepresence…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Guy Gafni , Justus Thies , Michael Zollhöfer , Matthias Nießner

We introduce Structured 3D Features, a model based on a novel implicit 3D representation that pools pixel-aligned image features onto dense 3D points sampled from a parametric, statistical human mesh surface. The 3D points have associated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Enric Corona , Mihai Zanfir , Thiemo Alldieck , Eduard Gabriel Bazavan , Andrei Zanfir , Cristian Sminchisescu

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Baixin Xu , Jiarui Zhang , Kwan-Yee Lin , Chen Qian , Ying He

This paper proposes a technique for efficiently modeling dynamic humans by explicifying the implicit neural fields via a Neural Explicit Surface (NES). Implicit neural fields have advantages over traditional explicit representations in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruiqi Zhang , Jie Chen , Qiang Wang

Recent years have witnessed significant progress in the field of neural surface reconstruction. While the extensive focus was put on volumetric and implicit approaches, a number of works have shown that explicit graphics primitives such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Sergey Prokudin , Qianli Ma , Maxime Raafat , Julien Valentin , Siyu Tang

Reconstructing high-quality 3D objects from sparse, partial observations from a single view is of crucial importance for various applications in computer vision, robotics, and graphics. While recent neural implicit modeling methods show…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Shivam Duggal , Zihao Wang , Wei-Chiu Ma , Sivabalan Manivasagam , Justin Liang , Shenlong Wang , Raquel Urtasun

We advocate the use of implicit fields for learning generative models of shapes and introduce an implicit field decoder, called IM-NET, for shape generation, aimed at improving the visual quality of the generated shapes. An implicit field…

Graphics · Computer Science 2019-09-18 Zhiqin Chen , Hao Zhang

Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Baowen Zhang , Jiahe Li , Xiaoming Deng , Yinda Zhang , Cuixia Ma , Hongan Wang

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

Recently, the reconstruction of high-fidelity 3D head models from static portrait image has made great progress. However, most methods require multi-view or multi-illumination information, which therefore put forward high requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xueying Wang , Juyong Zhang

3D head avatars built with neural implicit volumetric representations have achieved unprecedented levels of photorealism. However, the computational cost of these methods remains a significant barrier to their widespread adoption,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Ziqian Bai , Feitong Tan , Sean Fanello , Rohit Pandey , Mingsong Dou , Shichen Liu , Ping Tan , Yinda Zhang

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store scene properties in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Amit Kohli , Vincent Sitzmann , Gordon Wetzstein

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chiyu Max Jiang , Avneesh Sud , Ameesh Makadia , Jingwei Huang , Matthias Nießner , Thomas Funkhouser

We present implicit displacement fields, a novel representation for detailed 3D geometry. Inspired by a classic surface deformation technique, displacement mapping, our method represents a complex surface as a smooth base surface plus a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Wang Yifan , Lukas Rahmann , Olga Sorkine-Hornung