English
Related papers

Related papers: Improving Neural Radiance Fields with Depth-aware …

200 papers

Representing and synthesizing novel views in real-world dynamic scenes from casual monocular videos is a long-standing problem. Existing solutions typically approach dynamic scenes by applying geometry techniques or utilizing temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Boyu Zhang , Wenbo Xu , Zheng Zhu , Guan Huang

Recent techniques for real-time view synthesis have rapidly advanced in fidelity and speed, and modern methods are capable of rendering near-photorealistic scenes at interactive frame rates. At the same time, a tension has arisen between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Daniel Duckworth , Peter Hedman , Christian Reiser , Peter Zhizhin , Jean-François Thibert , Mario Lučić , Richard Szeliski , Jonathan T. Barron

Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Pascal Fua

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

We present a method to synthesize novel views from a single $360^\circ$ panorama image based on the neural radiance field (NeRF). Prior studies in a similar setting rely on the neighborhood interpolation capability of multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shreyas Kulkarni , Peng Yin , Sebastian Scherer

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

Panoramic observation using fisheye cameras is significant in virtual reality (VR) and robot perception. However, panoramic images synthesized by traditional methods lack depth information and can only provide three degrees-of-freedom…

Robotics · Computer Science 2024-11-05 Dongyu Yan , Guanyu Huang , Fengyu Quan , Haoyao Chen

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Michael Oechsle , Songyou Peng , Andreas Geiger

Recent advances in 3D scene representation and novel view synthesis have witnessed the rise of Neural Radiance Fields (NeRFs). Nevertheless, it is not trivial to exploit NeRF for the photorealistic 3D scene stylization task, which aims to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zicheng Zhang , Yinglu Liu , Congying Han , Yingwei Pan , Tiande Guo , Ting Yao

Neural radiance fields (NeRF) methods have demonstrated impressive novel view synthesis performance. The core approach is to render individual rays by querying a neural network at points sampled along the ray to obtain the density and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Relja Arandjelović , Andrew Zisserman

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Neural radiance fields (NeRFs) have enabled high fidelity 3D reconstruction from multiple 2D input views. However, a well-known drawback of NeRFs is the less-than-ideal performance under a small number of views, due to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mikaela Angelina Uy , Ricardo Martin-Brualla , Leonidas Guibas , Ke Li

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli