English
Related papers

Related papers: Implicit Neural Deformation for Sparse-View Face R…

200 papers

We introduce Structured 3D Features, a model based on a novel implicit 3D representation that pools pixel-aligned image features onto dense 3D points sampled from a parametric, statistical human mesh surface. The 3D points have associated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Enric Corona , Mihai Zanfir , Thiemo Alldieck , Eduard Gabriel Bazavan , Andrei Zanfir , Cristian Sminchisescu

This paper presents a novel approach for sparse 3D reconstruction by leveraging the expressive power of Neural Radiance Fields (NeRFs) and fast transfer of their features to learn accurate occupancy fields. Existing 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Shubhendu Jena , Franck Multon , Adnane Boukhayma

This paper presents a novel approach 4DRecons that takes a single camera RGB-D sequence of a dynamic subject as input and outputs a complete textured deforming 3D model over time. 4DRecons encodes the output as a 4D neural implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Xiaoyan Cong , Haitao Yang , Liyan Chen , Kaifeng Zhang , Li Yi , Chandrajit Bajaj , Qixing Huang

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have…

Robotics · Computer Science 2023-03-01 Dongyu Yan , Xiaoyang Lyu , Jieqi Shi , Yi Lin

High-quality 3D reconstruction of pulmonary segments plays a crucial role in segmentectomy and surgical planning for the treatment of lung cancer. Due to the resolution requirement of the target reconstruction, conventional deep…

Graphics · Computer Science 2025-12-16 Kangxian Xie , Yufei Zhu , Kaiming Kuang , Li Zhang , Hongwei Bran Li , Mingchen Gao , Jiancheng Yang

Inspired by the recent advances in implicitly representing signals with trained neural networks, we aim to learn a continuous representation for narrow-baseline 4D light fields. We propose an implicit representation model for 4D light…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Paramanand Chandramouli , Hendrik Sommerhoff , Andreas Kolb

Deep Implicit Functions (DIFs) have gained popularity in 3D computer vision due to their compactness and continuous representation capabilities. However, addressing dense correspondences and semantic relationships across DIF-encoded shapes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Kun Han , Shanlin Sun , Xiaohui Xie

Neural surfaces learning has shown impressive performance in multi-view surface reconstruction. However, most existing methods use large multilayer perceptrons (MLPs) to train their models from scratch, resulting in hours of training for a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jianyao Xu , Qingshan Xu , Xinyao Liao , Wanjuan Su , Chen Zhang , Yew-Soon Ong , Wenbing Tao

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Personalised 3D vascular models are valuable for diagnosis, prognosis and treatment planning in patients with cardiovascular disease. Traditionally, such models have been constructed with explicit representations such as meshes and voxel…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Dieuwertje Alblas , Christoph Brune , Kak Khee Yeung , Jelmer M. Wolterink

This paper addresses the limitations of neural rendering-based multi-view surface reconstruction methods, which require an additional mesh extraction step that is inconvenient and would produce poor-quality surfaces with mesh aliasing,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qitong Zhang , Jieqing Feng

Neural implicit representations have revolutionized dense multi-view surface reconstruction, yet their performance significantly diminishes with sparse input views. A few pioneering works have sought to tackle the challenge of sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Sheng Ye , Yuze He , Matthieu Lin , Jenny Sheng , Ruoyu Fan , Yiheng Han , Yubin Hu , Ran Yi , Yu-Hui Wen , Yong-Jin Liu , Wenping Wang

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

Efficiently reconstructing complex and intricate surfaces at scale is a long-standing goal in machine perception. To address this problem we introduce Deep Local Shapes (DeepLS), a deep shape representation that enables encoding and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Rohan Chabra , Jan Eric Lenssen , Eddy Ilg , Tanner Schmidt , Julian Straub , Steven Lovegrove , Richard Newcombe

Implicit neural representation has paved the way for new approaches to dynamic scene reconstruction and rendering. Nonetheless, cutting-edge dynamic neural rendering methods rely heavily on these implicit representations, which frequently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Xinyu Gao , Wen Zhou , Shaohui Jiao , Yuqing Zhang , Xiaogang Jin

Implicit representations of 3D objects have recently achieved impressive results on learning-based 3D reconstruction tasks. While existing works use simple texture models to represent object appearance, photo-realistic image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Michael Oechsle , Michael Niemeyer , Lars Mescheder , Thilo Strauss , Andreas Geiger

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Lutao Jiang , Ruyi Ji , Libo Zhang

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

We propose an end-to-end deep-learning approach for automatic rigging and retargeting of 3D models of human faces in the wild. Our approach, called Neural Face Rigging (NFR), holds three key properties: (i) NFR's expression space maintains…

Graphics · Computer Science 2023-05-16 Dafei Qin , Jun Saito , Noam Aigerman , Thibault Groueix , Taku Komura

Given only a set of images, neural implicit surface representation has shown its capability in 3D surface reconstruction. However, as the nature of per-scene optimization is based on the volumetric rendering of color, previous neural…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Jing Li , Jinpeng Yu , Ruoyu Wang , Zhengxin Li , Zhengyu Zhang , Lina Cao , Shenghua Gao