English
Related papers

Related papers: DyBluRF: Dynamic Neural Radiance Fields from Blurr…

200 papers

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

We present Multi-Baseline Radiance Fields (MuRF), a general feed-forward approach to solving sparse view synthesis under multiple different baseline settings (small and large baselines, and different number of input views). To render a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Haofei Xu , Anpei Chen , Yuedong Chen , Christos Sakaridis , Yulun Zhang , Marc Pollefeys , Andreas Geiger , Fisher Yu

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

We propose a novel geometric and photometric 3D mapping pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Antoni Rosinol , John J. Leonard , Luca Carlone

We present Knowledge NeRF to synthesize novel views for dynamic scenes. Reconstructing dynamic 3D scenes from few sparse views and rendering them from arbitrary perspectives is a challenging problem with applications in various domains.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenxiao Cai , Xinyue Lei , Xinyu He , Junming Leo Chen , Yangang Wang

Neural Radiance Fields (NeRFs) have become increasingly popular because of their impressive ability for novel view synthesis. However, their effectiveness is hindered by the Rolling Shutter (RS) effects commonly found in most camera…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Muyao Niu , Tong Chen , Yifan Zhan , Zhuoxiao Li , Xiang Ji , Yinqiang Zheng

Neural Radiance Fields (NeRF) accomplishes photo-realistic novel view synthesis by learning the implicit volumetric representation of a scene from multi-view images, which faithfully convey the colorimetric information. However, sensor…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jiacong Xu , Mingqian Liao , K Ram Prabhakar , Vishal M. Patel

We present the first framework capable of synthesizing the all-in-focus neural radiance field (NeRF) from inputs without manual refocusing. Without refocusing, the camera will automatically focus on the fixed object for all views, and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Xianrui Luo , Zijin Wu , Juewen Peng , Huiqiang Sun , Zhiguo Cao , Guosheng Lin

We present CG-NeRF, a cascade and generalizable neural radiance fields method for view synthesis. Recent generalizing view synthesis methods can render high-quality novel views using a set of nearby input views. However, the rendering speed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

Convenient 4D modeling of human-object interactions is essential for numerous applications. However, monocular tracking and rendering of complex interaction scenarios remain challenging. In this paper, we propose Instant-NVR, a neural…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Yuheng Jiang , Kaixin Yao , Zhuo Su , Zhehao Shen , Haimin Luo , Lan Xu

We propose a novel approach for 3D video synthesis that is able to represent multi-view video recordings of a dynamic real-world scene in a compact, yet expressive representation that enables high-quality view synthesis and motion…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Tianye Li , Mira Slavcheva , Michael Zollhoefer , Simon Green , Christoph Lassner , Changil Kim , Tanner Schmidt , Steven Lovegrove , Michael Goesele , Richard Newcombe , Zhaoyang Lv

Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Prune Truong , Marie-Julie Rakotosaona , Fabian Manhardt , Federico Tombari

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Existing methods for the 4D reconstruction of general, non-rigidly deforming objects focus on novel-view synthesis and neglect correspondences. However, time consistency enables advanced downstream tasks like 3D editing, motion analysis, or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Edith Tretschk , Vladislav Golyanik , Michael Zollhoefer , Aljaz Bozic , Christoph Lassner , Christian Theobalt

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

Neural radiance fields (NeRF) excel at synthesizing new views given multi-view, calibrated images of a static scene. When scenes include distractors, which are not persistent during image capture (moving objects, lighting variations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Sara Sabour , Suhani Vora , Daniel Duckworth , Ivan Krasin , David J. Fleet , Andrea Tagliasacchi

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

In recent years, the field of implicit neural representation has progressed significantly. Models such as neural radiance fields (NeRF), which uses relatively small neural networks, can represent high-quality scenes and achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 David Dadon , Ohad Fried , Yacov Hel-Or

Neural rendering has demonstrated remarkable success in dynamic scene reconstruction. Thanks to the expressiveness of neural representations, prior works can accurately capture the motion and achieve high-fidelity reconstruction of the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Hengyi Wang , Jingwen Wang , Lourdes Agapito