English
Related papers

Related papers: Ray-Distance Volume Rendering for Neural Scene Rec…

200 papers

We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Peng Wang , Lingjie Liu , Yuan Liu , Christian Theobalt , Taku Komura , Wenping Wang

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Neural volume rendering became increasingly popular recently due to its success in synthesizing novel views of a scene from a sparse set of input images. So far, the geometry learned by neural volume rendering techniques was modeled using a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Lior Yariv , Jiatao Gu , Yoni Kasten , Yaron Lipman

We propose a novel 3D spatial representation for data fusion and scene reconstruction. Probabilistic Signed Distance Function (Probabilistic SDF, PSDF) is proposed to depict uncertainties in the 3D space. It is modeled by a joint…

Robotics · Computer Science 2018-07-31 Wei Dong , Qiuyuan Wang , Xin Wang , Hongbin Zha

Computer graphics, 3D computer vision and robotics communities have produced multiple approaches to representing 3D geometry for rendering and reconstruction. These provide trade-offs across fidelity, efficiency and compression…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Jeong Joon Park , Peter Florence , Julian Straub , Richard Newcombe , Steven Lovegrove

Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Yiqun Wang , Ivan Skorokhodov , Peter Wonka

Signed distance functions (SDFs) is an attractive framework that has recently shown promising results for 3D shape reconstruction from images. SDFs seamlessly generalize to different shape resolutions and topologies but lack explicit…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Zerui Chen , Shizhe Chen , Cordelia Schmid , Ivan Laptev

Dense 3D object reconstruction from a single image has recently witnessed remarkable advances, but supervising neural networks with ground-truth 3D shapes is impractical due to the laborious process of creating paired image-shape datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Chen-Hsuan Lin , Chaoyang Wang , Simon Lucey

Neural 3D implicit representations learn priors that are useful for diverse applications, such as single- or multiple-view 3D reconstruction. A major downside of existing approaches while rendering an image is that they require evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Tarun Yenamandra , Ayush Tewari , Nan Yang , Florian Bernard , Christian Theobalt , Daniel Cremers

We introduce a new generative approach for synthesizing 3D geometry and images from single-view collections. Most existing approaches predict volumetric density to render multi-view consistent images. By employing volumetric rendering using…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Salvatore Esposito , Qingshan Xu , Kacper Kania , Charlie Hewitt , Octave Mariotti , Lohit Petikam , Julien Valentin , Arno Onken , Oisin Mac Aodha

We represent the ResNeRF, a novel geometry-guided two-stage framework for indoor scene novel view synthesis. Be aware of that a good geometry would greatly boost the performance of novel view synthesis, and to avoid the geometry ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yuting Xiao , Yiqun Zhao , Yanyu Xu , Shenghua Gao

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Lutao Jiang , Ruyi Ji , Libo Zhang

We propose a novel method for reconstructing explicit parameterized surfaces from Signed Distance Fields (SDFs), a widely used implicit neural representation (INR) for 3D surfaces. While traditional reconstruction methods like Marching…

Graphics · Computer Science 2024-10-07 Haotian Yin , Przemyslaw Musialski

We propose SDFDiff, a novel approach for image-based shape optimization using differentiable rendering of 3D shapes represented by signed distance functions (SDFs). Compared to other representations, SDFs have the advantage that they can…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yue Jiang , Dantong Ji , Zhizhong Han , Matthias Zwicker

Recently, it has shown that priors are vital for neural implicit functions to reconstruct high-quality surfaces from multi-view RGB images. However, current priors require large-scale pre-training, and merely provide geometric clues without…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenyuan Zhang , Emily Yue-ting Jia , Junsheng Zhou , Baorui Ma , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Neural radiance fields (NeRF) have driven impressive progress in view synthesis by using ray-traced volumetric rendering. Splatting-based methods such as 3D Gaussian Splatting (3DGS) provide faster rendering by rasterizing 3D primitives.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Antonella Rech , Nicola Conci , Nicola Garau

Surface reconstruction from multi-view images is a core challenge in 3D vision. Recent studies have explored signed distance fields (SDF) within Neural Radiance Fields (NeRF) to achieve high-fidelity surface reconstructions. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Baixin Xu , Jiangbei Hu , Jiaze Li , Ying He

Accurate and efficient environment representation is crucial for robotic applications such as motion planning, manipulation, and navigation. Signed distance functions (SDFs) have emerged as a powerful representation for encoding distance to…

Robotics · Computer Science 2026-04-01 Zhirui Dai , Tianxing Fan , Mani Amani , Jaemin Seo , Ki Myung Brian Lee , Hyondong Oh , Nikolay Atanasov

Multi-view neural surface reconstruction has exhibited impressive results. However, a notable limitation is the prohibitively slow inference time when compared to traditional techniques, primarily attributed to the dense sampling, required…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Chaerin Min , Sehyun Cha , Changhee Won , Jongwoo Lim