English
Related papers

Related papers: MINE: Towards Continuous Depth MPI with NeRF for N…

200 papers

Neural Radiance Field (NeRF) has achieved substantial progress in novel view synthesis given multi-view images. Recently, some works have attempted to train a NeRF from a single image with 3D priors. They mainly focus on a limited field of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Guangcong Wang , Peng Wang , Zhaoxi Chen , Wenping Wang , Chen Change Loy , Ziwei Liu

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

The task of synthesizing novel views from a single image has useful applications in virtual reality and mobile computing, and a number of approaches to the problem have been proposed in recent years. A Multiplane Image (MPI) estimates the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Numair Khan , Douglas Lanman , Lei Xiao

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

Neural radiance fields (NeRF) have achieved impressive performances in view synthesis by encoding neural representations of a scene. However, NeRFs require hundreds of images per scene to synthesize photo-realistic novel views. Training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nagabhushan Somraj , Rajiv Soundararajan

In this paper, we introduce a new challenge for synthesizing novel view images in practical environments with limited input multi-view images and varying lighting conditions. Neural radiance fields (NeRF), one of the pioneering works for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 SeokYeong Lee , JunYong Choi , Seungryong Kim , Ig-Jae Kim , Junghyun Cho

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Iryna Repinetska , Anna Hilsmann , Peter Eisert

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruction capabilities with dense view images. However, its performance significantly deteriorates under sparse view settings. We observe that learning the 3D consistency of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Shoukang Hu , Kaichen Zhou , Kaiyu Li , Longhui Yu , Lanqing Hong , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Ziwei Liu

Neural radiance fields (NeRFs) have enabled high fidelity 3D reconstruction from multiple 2D input views. However, a well-known drawback of NeRFs is the less-than-ideal performance under a small number of views, due to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mikaela Angelina Uy , Ricardo Martin-Brualla , Leonidas Guibas , Ke Li

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Young Chun Ahn , Seokhwan Jang , Sungheon Park , Ji-Yeon Kim , Nahyup Kang

Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images of the scene from diverse viewpoints to render high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Felix Tristram , Stefano Gasperini , Nassir Navab , Federico Tombari

In recent years, the performance of novel view synthesis using perspective images has dramatically improved with the advent of neural radiance fields (NeRF). This study proposes two novel techniques that effectively build NeRF for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Takashi Otonari , Satoshi Ikehata , Kiyoharu Aizawa

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Anh-Quan Cao , Raoul de Charette

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Michael Oechsle , Songyou Peng , Andreas Geiger

2D-to-3D reconstruction is an ill-posed problem, yet humans are good at solving this problem due to their prior knowledge of the 3D world developed over years. Driven by this observation, we propose NeRDi, a single-view NeRF synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Congyue Deng , Chiyu "Max'' Jiang , Charles R. Qi , Xinchen Yan , Yin Zhou , Leonidas Guibas , Dragomir Anguelov

Industrial 3D face assets creation typically reconstructs topology-consistent face meshes from multi-view images for downstream production. However, high-quality reconstruction usually requires manual processing or specific capture…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yating Wang , Ran Yi , Xiaoning Lei , Ke Fan , Jinkun Hao , Lizhuang Ma

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

In this work, we present a new multi-view depth estimation method that utilizes both conventional reconstruction and learning-based priors over the recently proposed neural radiance fields (NeRF). Unlike existing neural network based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Yi Wei , Shaohui Liu , Yongming Rao , Wang Zhao , Jiwen Lu , Jie Zhou