English
Related papers

Related papers: MonoPatchNeRF: Improving Neural Radiance Fields wi…

200 papers

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

Recent works have shown the benefit of integrating Conditional Random Fields (CRFs) models into deep architectures for improving pixel-level prediction tasks. Following this line of research, in this paper we introduce a novel approach for…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Dan Xu , Wei Wang , Hao Tang , Hong Liu , Nicu Sebe , Elisa Ricci

The success of neural fields for 3D vision tasks is now indisputable. Following this trend, several methods aiming for visual localization (e.g., SLAM) have been proposed to estimate distance or density fields using neural fields. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Itsuki Ueda , Yoshihiro Fukuhara , Hirokatsu Kataoka , Hiroaki Aizawa , Hidehiko Shishido , Itaru Kitahara

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Shilei Sun , Ming Liu , Zhongyi Fan , Yuxue Liu , Chengwei Lv , Liquan Dong , Lingqin Kong

Recent neural view synthesis methods have achieved impressive quality and realism, surpassing classical pipelines which rely on multi-view reconstruction. State-of-the-Art methods, such as NeRF, are designed to learn a single scene with a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Julian Chibane , Aayush Bansal , Verica Lazova , Gerard Pons-Moll

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D representation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Monocular depth estimation has drawn widespread attention from the vision community due to its broad applications. In this paper, we propose a novel physics (geometry)-driven deep learning framework for monocular depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Shuwei Shao , Zhongcai Pei , Weihai Chen , Xingming Wu , Zhengguo Li

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Li Ma , Xiaoyu Li , Jing Liao , Qi Zhang , Xuan Wang , Jue Wang , Pedro V. Sander

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu

In the fields of computer graphics, computer vision and photogrammetry, Neural Radiance Fields (NeRFs) are a major topic driving current research and development. However, the quality of NeRF-generated 3D scene reconstructions and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Miriam Jäger , Steven Landgraf , Boris Jutzi

The goal of our work is to generate high-quality novel views from monocular videos of complex and dynamic scenes. Prior methods, such as DynamicNeRF, have shown impressive performance by leveraging time-varying dynamic radiation fields.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xingyu Miao , Yang Bai , Haoran Duan , Yawen Huang , Fan Wan , Yang Long , Yefeng Zheng

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

The rendering procedure used by neural radiance fields (NeRF) samples a scene with a single ray per pixel and may therefore produce renderings that are excessively blurred or aliased when training or testing images observe scene content at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jonathan T. Barron , Ben Mildenhall , Matthew Tancik , Peter Hedman , Ricardo Martin-Brualla , Pratul P. Srinivasan

Given a monocular video, segmenting and decoupling dynamic objects while recovering the static environment is a widely studied problem in machine intelligence. Existing solutions usually approach this problem in the image domain, limiting…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Tianhao Wu , Fangcheng Zhong , Andrea Tagliasacchi , Forrester Cole , Cengiz Oztireli

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

Neural Radiance Fields (NeRF) achieves impressive 3D representation learning and novel view synthesis results with high-quality multi-view images as input. However, motion blur in images often occurs in low-light and high-speed motion…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yunshan Qi , Lin Zhu , Yifan Zhao , Nan Bao , Jia Li