English
Related papers

Related papers: DynamicSurf: Dynamic Neural RGB-D Surface Reconstr…

200 papers

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. Previous work on learning shape reconstruction from multiple views uses discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Jiahui Lei , Srinath Sridhar , Paul Guerrero , Minhyuk Sung , Niloy Mitra , Leonidas J. Guibas

We introduce TransformerFusion, a transformer-based 3D scene reconstruction approach. From an input monocular RGB video, the video frames are processed by a transformer network that fuses the observations into a volumetric feature grid…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Aljaž Božič , Pablo Palafox , Justus Thies , Angela Dai , Matthias Nießner

Reconstructing dynamic 3D garment surfaces with open boundaries from monocular videos is an important problem as it provides a practical and low-cost solution for clothes digitization. Recent neural rendering methods achieve high-quality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lingteng Qiu , Guanying Chen , Jiapeng Zhou , Mutian Xu , Junle Wang , Xiaoguang Han

Current multi-view 3D reconstruction methods rely on accurate camera calibration and pose estimation, requiring complex and time-intensive pre-processing that hinders their practical deployment. To address this challenge, we introduce…

Graphics · Computer Science 2025-08-07 Haodong Zhu , Changbai Li , Yangyang Ren , Zichao Feng , Xuhui Liu , Hanlin Chen , Xiantong Zhen , Baochang Zhang

We present a method for differentiable rendering of 3D surfaces that supports both explicit and implicit representations, provides derivatives at occlusion boundaries, and is fast and simple to implement. The method first samples the…

Graphics · Computer Science 2021-08-12 Forrester Cole , Kyle Genova , Avneesh Sud , Daniel Vlasic , Zhoutong Zhang

We present a novel method for reconstructing a 3D implicit surface from a large-scale, sparse, and noisy point cloud. Our approach builds upon the recently introduced Neural Kernel Fields (NKF) representation. It enjoys similar…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiahui Huang , Zan Gojcic , Matan Atzmon , Or Litany , Sanja Fidler , Francis Williams

Monocular dense 3D reconstruction of deformable objects is a hard ill-posed problem in computer vision. Current techniques either require dense correspondences and rely on motion and deformation cues, or assume a highly accurate…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Vladislav Golyanik , Soshi Shimada , Kiran Varanasi , Didier Stricker

We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Our method does not require a pre-defined shape template to start with and builds up the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Matthias Innmann , Michael Zollhöfer , Matthias Nießner , Christian Theobalt , Marc Stamminger

We propose a novel framework for the statistical analysis of genus-zero 4D surfaces, i.e., 3D surfaces that deform and evolve over time. This problem is particularly challenging due to the arbitrary parameterizations of these surfaces and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Awais Nizamani , Hamid Laga , Guanjin Wang , Farid Boussaid , Mohammed Bennamoun , Anuj Srivastava

Reconstructing dynamic, time-varying scenes with computed tomography (4D-CT) is a challenging and ill-posed problem common to industrial and medical settings. Existing 4D-CT reconstructions are designed for sparse sampling schemes that…

Image and Video Processing · Electrical Eng. & Systems 2021-04-26 Albert W. Reed , Hyojin Kim , Rushil Anirudh , K. Aditya Mohan , Kyle Champley , Jingu Kang , Suren Jayasuriya

We present a novel non-rigid reconstruction method using a moving RGB-D camera. Current approaches use only non-rigid part of the scene and completely ignore the rigid background. Non-rigid parts often lack sufficient geometric and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Shafeeq Elanattil , Peyman Moghadam , Sridha Sridharan , Clinton Fookes , Mark Cox

Implicit surface representations such as the signed distance function (SDF) have emerged as a promising approach for image-based surface reconstruction. However, existing optimization methods assume solid surfaces and are therefore unable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Tianhao Wu , Hanxue Liang , Fangcheng Zhong , Gernot Riegler , Shimon Vainer , Jiankang Deng , Cengiz Oztireli

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

3D reconstruction of highly deformable surfaces (e.g. cloths) from monocular RGB videos is a challenging problem, and no solution provides a consistent and accurate recovery of fine-grained surface details. To account for the ill-posed…

Graphics · Computer Science 2025-03-27 Navami Kairanda , Marc Habermann , Shanthika Naik , Christian Theobalt , Vladislav Golyanik

Representing 3D objects and scenes with neural radiance fields has become very popular over the last years. Recently, surface-based representations have been proposed, that allow to reconstruct 3D objects from simple photographs. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Sarthak Gupta , Patrik Huber

Recently, the reconstruction of high-fidelity 3D head models from static portrait image has made great progress. However, most methods require multi-view or multi-illumination information, which therefore put forward high requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xueying Wang , Juyong Zhang

We present NeRSP, a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. Reflective surface reconstruction is extremely challenging as specular reflections are view-dependent and thus violate the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yufei Han , Heng Guo , Koki Fukai , Hiroaki Santo , Boxin Shi , Fumio Okura , Zhanyu Ma , Yunpeng Jia

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Neural surface reconstruction aims to reconstruct accurate 3D surfaces based on multi-view images. Previous methods based on neural volume rendering mostly train a fully implicit model with MLPs, which typically require hours of training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tong Wu , Jiaqi Wang , Xingang Pan , Xudong Xu , Christian Theobalt , Ziwei Liu , Dahua Lin

We are witnessing an explosion of neural implicit representations in computer vision and graphics. Their applicability has recently expanded beyond tasks such as shape generation and image-based rendering to the fundamental problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Jiaming Sun , Xi Chen , Qianqian Wang , Zhengqi Li , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely