English
Related papers

Related papers: FreeDriveRF: Monocular RGB Dynamic NeRF without Po…

200 papers

Neural rendering has garnered substantial attention owing to its capacity for creating realistic 3D scenes. However, its applicability to extensive scenes remains challenging, with limitations in effectiveness. In this work, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Zhihao Jia , Bing Wang , Changhao Chen

We propose a generalizable neural radiance fields - MonoNeRF, that can be trained on large-scale monocular videos of moving in static scenes without any ground-truth annotations of depth and camera poses. MonoNeRF follows an…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yang Fu , Ishan Misra , Xiaolong Wang

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand. Existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhuopeng Li , Chenming Wu , Liangjun Zhang , Jianke Zhu

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

Driving scenes are extremely diverse and complicated that it is impossible to collect all cases with human effort alone. While data augmentation is an effective technique to enrich the training data, existing methods for camera data in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Wenwen Tong , Jiangwei Xie , Tianyu Li , Hanming Deng , Xiangwei Geng , Ruoyi Zhou , Dingchen Yang , Bo Dai , Lewei Lu , Hongyang Li

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 ShahRukh Athar , Zhixin Shu , Zexiang Xu , Fujun Luan , Sai Bi , Kalyan Sunkavalli , Dimitris Samaras

Training a Neural Radiance Field (NeRF) without pre-computed camera poses is challenging. Recent advances in this direction demonstrate the possibility of jointly optimising a NeRF and camera poses in forward-facing scenes. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Wenjing Bian , Zirui Wang , Kejie Li , Jia-Wang Bian , Victor Adrian Prisacariu

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

The task of separating dynamic objects from static environments using NeRFs has been widely studied in recent years. However, capturing large-scale scenes still poses a challenge due to their complex geometric structures and unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Thang-Anh-Quan Nguyen , Luis Roldão , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou

In this paper, we target at the problem of learning a generalizable dynamic radiance field from monocular videos. Different from most existing NeRF methods that are based on multiple views, monocular videos only contain one view at each…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Fengrui Tian , Shaoyi Du , Yueqi Duan

Generating free-viewpoint videos is critical for immersive VR/AR experience but recent neural advances still lack the editing ability to manipulate the visual perception for large dynamic scenes. To fill this gap, in this paper we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Jiakai Zhang , Xinhang Liu , Xinyi Ye , Fuqiang Zhao , Yanshun Zhang , Minye Wu , Yingliang Zhang , Lan Xu , Jingyi Yu

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

We introduce AutoRF - a new approach for learning neural 3D object representations where each object in the training set is observed by only a single view. This setting is in stark contrast to the majority of existing works that leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Norman Müller , Andrea Simonelli , Lorenzo Porzi , Samuel Rota Bulò , Matthias Nießner , Peter Kontschieder

Addressing the intricate challenge of modeling and re-rendering dynamic scenes, most recent approaches have sought to simplify these complexities using plane-based explicit representations, overcoming the slow training time issues…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Ange Lou , Benjamin Planche , Zhongpai Gao , Yamin Li , Tianyu Luan , Hao Ding , Terrence Chen , Jack Noble , Ziyan Wu

The success of the Neural Radiance Fields (NeRFs) for modeling and free-view rendering static objects has inspired numerous attempts on dynamic scenes. Current techniques that utilize neural rendering for facilitating free-view videos…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Liao Wang , Qiang Hu , Qihan He , Ziyu Wang , Jingyi Yu , Tinne Tuytelaars , Lan Xu , Minye Wu

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Guanjun Wu , Taoran Yi , Jiemin Fang , Wenyu Liu , Xinggang Wang

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Learning accurate scene reconstruction without pose priors in neural radiance fields is challenging due to inherent geometric ambiguity. Recent development either relies on correspondence priors for regularization or uses off-the-shelf flow…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xunzhi Zheng , Dan Xu