English
Related papers

Related papers: Multi-style Neural Radiance Field with AdaIN

200 papers

Neural Radiance Fields (NeRF) have emerged as a potent paradigm for representing scenes and synthesizing photo-realistic images. A main limitation of conventional NeRFs is that they often fail to produce high-quality renderings under novel…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jian Zhang , Yuanqing Zhang , Huan Fu , Xiaowei Zhou , Bowen Cai , Jinchi Huang , Rongfei Jia , Binqiang Zhao , Xing Tang

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

Neural radiance field is an emerging rendering method that generates high-quality multi-view consistent images from a neural scene representation and volume rendering. Although neural radiance field-based techniques are robust for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ka Chun Shum , Jaeyeon Kim , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

Despite the emergence of successful NeRF inpainting methods built upon explicit RGB and depth 2D inpainting supervisions, these methods are inherently constrained by the capabilities of their underlying 2D inpainters. This is due to two key…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Honghua Chen , Chen Change Loy , Xingang Pan

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

Neural radiance fields (NeRF) encode a scene into a neural representation that enables photo-realistic rendering of novel views. However, a successful reconstruction from RGB images requires a large number of input views taken under static…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Barbara Roessle , Jonathan T. Barron , Ben Mildenhall , Pratul P. Srinivasan , Matthias Nießner

Current Neural Radiance Fields (NeRF) can generate photorealistic novel views. For editing 3D scenes represented by NeRF, with the advent of generative models, this paper proposes Inpaint4DNeRF to capitalize on state-of-the-art stable…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Han Jiang , Haosen Sun , Ruoxuan Li , Chi-Keung Tang , Yu-Wing Tai

Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chieh Hubert Lin , Changil Kim , Jia-Bin Huang , Qinbo Li , Chih-Yao Ma , Johannes Kopf , Ming-Hsuan Yang , Hung-Yu Tseng

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , Jiajun Wu

Neural Radiance Fields (NeRF) have demonstrated impressive potential in synthesizing novel views from dense input, however, their effectiveness is challenged when dealing with sparse input. Existing approaches that incorporate additional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Zhangkai Ni , Peiqi Yang , Wenhan Yang , Hanli Wang , Lin Ma , Sam Kwong

Implicit neural rendering techniques have shown promising results for novel view synthesis. However, existing methods usually encode the entire scene as a whole, which is generally not aware of the object identity and limits the ability to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Bangbang Yang , Yinda Zhang , Yinghao Xu , Yijin Li , Han Zhou , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Liangchen Song , Liangliang Cao , Jiatao Gu , Yifan Jiang , Junsong Yuan , Hao Tang

Neural Radiance Fields (NeRFs), despite their outstanding performance on novel view synthesis, often need dense input views. Many papers train one model for each scene respectively and few of them explore incorporating multi-modal data into…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Haoyi Zhu , Hao-Shu Fang , Cewu Lu

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Optical sensor applications have become popular through digital transformation. Linking observed data to real-world locations and combining different image sensors is essential to make the applications practical and efficient. However, data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Kana Kurata , Hitoshi Niigaki , Xiaojun Wu , Ryuichi Tanida

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Georgios Kopanas , Julien Philip , Thomas Leimkühler , George Drettakis