English
Related papers

Related papers: UNISURF: Unifying Neural Implicit Surfaces and Rad…

200 papers

Object-centric surface reconstruction from multi-view images is crucial in creating editable digital assets for AR/VR. Due to the lack of geometric constraints, existing methods, e.g., NeuS necessitate annotating the object masks to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Haotian Bai , Yize Chen , Lin Wang

Recent works on implicit neural representations have made significant strides. Learning implicit neural surfaces using volume rendering has gained popularity in multi-view reconstruction without 3D supervision. However, accurately…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Decai Chen , Peng Zhang , Ingo Feldmann , Oliver Schreer , Peter Eisert

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

With Neural Radiance Fields (NeRFs) arising as a powerful 3D representation, research has investigated its various downstream tasks, including inpainting NeRFs with 2D images. Despite successful efforts addressing the view consistency and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Jingyu Shi , Achleshwar Luthra , Jiazhi Li , Xiang Gao , Xiyun Song , Zongfang Lin , David Gu , Heather Yu

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Neural Radiance Fields (NeRF) achieves unprecedented performance in synthesizing novel view synthesis, utilizing multi-view consistency. When capturing multiple inputs, image signal processing (ISP) in modern cameras will independently…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yuehao Wang , Chaoyi Wang , Bingchen Gong , Tianfan Xue

3D surface reconstruction from images is essential for numerous applications. Recently, Neural Radiance Fields (NeRFs) have emerged as a promising framework for 3D modeling. However, NeRFs require accurate camera poses as input, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yiyang Chen , Siyan Dong , Xulong Wang , Lulu Cai , Youyi Zheng , Yanchao Yang

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

Reconstructing the high-fidelity surface from multi-view images, especially sparse images, is a critical and practical task that has attracted widespread attention in recent years. However, existing methods are impeded by the memory…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Rui Peng , Shihe Shen , Kaiqiang Xiong , Huachen Gao , Jianbo Jiao , Xiaodong Gu , Ronggang Wang

Neural radiance fields (NeRFs) have achieved impressive view synthesis results by learning an implicit volumetric representation from multi-view images. To project the implicit representation into an image, NeRF employs volume rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Y. Wang , J. Xu , Y. Zeng , Y. Gong

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

We present a novel single-stage framework, Neural Photon Field (NePF), to address the ill-posed inverse rendering from multi-view images. Contrary to previous methods that recover the geometry, material, and illumination in multiple stages…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Tuen-Yue Tsui , Qin Zou

Current methods for performing 3D reconstruction and novel view synthesis (NVS) in ultrasound imaging data often face severe artifacts when training NeRF-based approaches. The artifacts produced by current approaches differ from NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Rishit Dagli , Atsuhiro Hibi , Rahul G. Krishnan , Pascal N. Tyrrell

We study the problem of inferring an object-centric scene representation from a single image, aiming to derive a representation that explains the image formation process, captures the scene's 3D nature, and is learned without supervision.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Hong-Xing Yu , Leonidas J. Guibas , Jiajun Wu

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural Radiance Fields (NeRF) achieve remarkable performance in dense multi-view scenarios, but their reconstruction quality degrades significantly under sparse inputs due to geometric artifacts. Existing methods utilize global depth…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weiqi Yu , Yiyang Yao , Lin He , Jianming Lv

Recently, Neural Radiance Field (NeRF) has shown great success in rendering novel-view images of a given scene by learning an implicit representation with only posed RGB images. NeRF and relevant neural field methods (e.g., neural surface…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zeke Xie , Xindi Yang , Yujie Yang , Qi Sun , Yixiang Jiang , Haoran Wang , Yunfeng Cai , Mingming Sun

Recent work on Neural Radiance Fields (NeRF) exploits multi-view 3D consistency, achieving impressive results in 3D scene modeling and high-fidelity novel-view synthesis. However, there are limitations. First, existing methods assume enough…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Mengfei Li , Ming Lu , Xiaofang Li , Shanghang Zhang

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer