English
Related papers

Related papers: Neural 3D Reconstruction in the Wild

200 papers

Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point cloud. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chao Chen , Yu-Shen Liu , Zhizhong Han

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Production of photorealistic, navigable 3D site models requires a large volume of carefully collected images that are often unavailable to first responders for disaster relief or law enforcement. Real-world challenges include limited…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Neil Joshi , Joshua Carney , Nathanael Kuo , Homer Li , Cheng Peng , Myron Brown

Modeling and rendering of dynamic scenes is challenging, as natural scenes often contain complex phenomena such as thin structures, evolving topology, translucency, scattering, occlusion, and biological motion. Mesh-based reconstruction and…

Graphics · Computer Science 2019-08-14 Stephen Lombardi , Tomas Simon , Jason Saragih , Gabriel Schwartz , Andreas Lehrmann , Yaser Sheikh

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have…

Robotics · Computer Science 2023-03-01 Dongyu Yan , Xiaoyang Lyu , Jieqi Shi , Yi Lin

The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e.g., Street View). Given a sequence of posed RGB…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Konstantinos Rematas , Andrew Liu , Pratul P. Srinivasan , Jonathan T. Barron , Andrea Tagliasacchi , Thomas Funkhouser , Vittorio Ferrari

We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Peng Wang , Lingjie Liu , Yuan Liu , Christian Theobalt , Taku Komura , Wenping Wang

We proposed a generalized method, NeuralSSD, for reconstructing a 3D implicit surface from the widely-available point cloud data. NeuralSSD is a solver-based on the neural Galerkin method, aimed at reconstructing higher-quality and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zi-Chen Xi , Jiahui Huang , Hao-Xiang Chen , Francis Williams , Qun-Ce Xu , Tai-Jiang Mu , Shi-Min Hu

This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for input and dense…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Chong Cheng , Gaochao Song , Yiyang Yao , Qinzheng Zhou , Gangjian Zhang , Hao Wang

3D Morphable Model (3DMM) based methods have achieved great success in recovering 3D face shapes from single-view images. However, the facial textures recovered by such methods lack the fidelity as exhibited in the input images. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiangke Lin , Yi Yuan , Tianjia Shao , Kun Zhou

Photographs captured in unstructured tourist environments frequently exhibit variable appearances and transient occlusions, challenging accurate scene reconstruction and inducing artifacts in novel view synthesis. Although prior approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiacong Xu , Yiqun Mei , Vishal M. Patel

When created faithfully from real-world data, Digital 3D representations of objects can be useful for human or computer-assisted analysis. Such models can also serve for generating training data for machine learning approaches in settings…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 David Nakath , Xiangyu Weng , Mengkun She , Kevin Köser

Over the past two decades, mobile imaging has experienced a profound transformation, with cell phones rapidly eclipsing all other forms of digital photography in popularity. Today's cell phones are equipped with a diverse range of imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ilya Chugunov

Solving image-to-3D from a single view is an ill-posed problem, and current neural reconstruction methods addressing it through diffusion models still rely on scene-specific optimization, constraining their generalization capability. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Christian Simon , Sen He , Juan-Manuel Perez-Rua , Mengmeng Xu , Amine Benhalloum , Tao Xiang

We propose a novel explicit dense 3D reconstruction approach that processes a set of images of a scene with sensor poses and calibrations and estimates a photo-real digital model. One of the key innovations is that the underlying volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Samir Aroudj , Steven Lovegrove , Eddy Ilg , Tanner Schmidt , Michael Goesele , Richard Newcombe

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optimizing both the shape…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chunyu Li , Taisuke Hashimoto , Eiichi Matsumoto , Hiroharu Kato

This comparative study evaluates various neural surface reconstruction methods, particularly focusing on their implications for scientific visualization through reconstructing 3D surfaces via multi-view rendering images. We categorize ten…

Graphics · Computer Science 2024-07-31 Siyuan Yao , Weixi Song , Chaoli Wang

Multi-view implicit scene reconstruction methods have become increasingly popular due to their ability to represent complex scene details. Recent efforts have been devoted to improving the representation of input information and to reducing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Edward J. Smith , Michal Drozdzal , Derek Nowrouzezahrai , David Meger , Adriana Romero-Soriano

Shape reconstruction from imaging volumes is a recurring need in medical image analysis. Common workflows start with a segmentation step, followed by careful post-processing and,finally, ad hoc meshing algorithms. As this sequence can be…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Antonio Pepe , Richard Schussnig , Jianning Li , Christina Gsaxner , Dieter Schmalstieg , Jan Egger

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth