English
Related papers

Related papers: Generalizable Patch-Based Neural Rendering

200 papers

In this paper, we propose SpectralNeRF, an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. We modify the classical spectral rendering into two main…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ru Li , Jia Liu , Guanghui Liu , Shengping Zhang , Bing Zeng , Shuaicheng Liu

In this paper, we present a novel and effective framework, named 4K-NeRF, to pursue high fidelity view synthesis on the challenging scenarios of ultra high resolutions, building on the methodology of neural radiance fields (NeRF). The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhongshu Wang , Lingzhi Li , Zhen Shen , Li Shen , Liefeng Bo

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Junyi Zeng , Chong Bao , Rui Chen , Zilong Dong , Guofeng Zhang , Hujun Bao , Zhaopeng Cui

Recent implicit neural rendering methods have demonstrated that it is possible to learn accurate view synthesis for complex scenes by predicting their volumetric density and color supervised solely by a set of RGB images. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Julian Ost , Fahim Mannan , Nils Thuerey , Julian Knodt , Felix Heide

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

Differentiable volumetric rendering-based methods made significant progress in novel view synthesis. On one hand, innovative methods have replaced the Neural Radiance Fields (NeRF) network with locally parameterized structures, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Hugo Blanc , Jean-Emmanuel Deschaud , Alexis Paljic

In this paper, we aim to learn a semantic radiance field from multiple scenes that is accurate, efficient and generalizable. While most existing NeRFs target at the tasks of neural scene rendering, image synthesis and multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Fangfu Liu , Chubin Zhang , Yu Zheng , Yueqi Duan

Recent advancements in the Neural Radiance Field (NeRF) have enhanced its capabilities for novel view synthesis, yet its reliance on dense multi-view training images poses a practical challenge, often leading to artifacts and a lack of fine…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Seunghyeon Seo , Yeonjin Chang , Jayeon Yoo , Seungwoo Lee , Hojun Lee , Nojun Kwak

This paper aims to tackle the challenge of efficiently producing interactive free-viewpoint videos. Some recent works equip neural radiance fields with image encoders, enabling them to generalize across scenes. When processing dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Haotong Lin , Sida Peng , Zhen Xu , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

We present a method to synthesize novel views from a single $360^\circ$ panorama image based on the neural radiance field (NeRF). Prior studies in a similar setting rely on the neighborhood interpolation capability of multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shreyas Kulkarni , Peng Yin , Sebastian Scherer

This paper proposes a neural radiance field (NeRF) approach for novel view synthesis of dynamic scenes using forward warping. Existing methods often adopt a static NeRF to represent the canonical space, and render dynamic images at other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiang Guo , Jiadai Sun , Yuchao Dai , Guanying Chen , Xiaoqing Ye , Xiao Tan , Errui Ding , Yumeng Zhang , Jingdong Wang

Recent neural rendering methods have demonstrated accurate view interpolation by predicting volumetric density and color with a neural network. Although such volumetric representations can be supervised on static and dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Julian Knodt , Joe Bartusek , Seung-Hwan Baek , Felix Heide

We introduce Neural Point Light Fields that represent scenes implicitly with a light field living on a sparse point cloud. Combining differentiable volume rendering with learned implicit density representations has made it possible to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Julian Ost , Issam Laradji , Alejandro Newell , Yuval Bahat , Felix Heide

In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Qunjie Zhou , Maxim Maximov , Or Litany , Laura Leal-Taixé

Novel view synthesis has recently made significant progress with the advent of Neural Radiance Fields (NeRF). DietNeRF is an extension of NeRF that aims to achieve this task from only a few images by introducing a new loss function for…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Daiju Kanaoka , Motoharu Sonogashira , Hakaru Tamukoh , Yasutomo Kawanishi

We present a neural rendering framework for simultaneous view synthesis and appearance editing of a scene from multi-view images captured under known environment illumination. Existing approaches either achieve view synthesis alone or view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Pulkit Gera , Aakash KT , Dhawal Sirikonda , Parikshit Sakurikar , P. J. Narayanan

Generalizable Neural Radiance Fields (GNeRF) are one of the most promising real-world solutions for novel view synthesis, thanks to their cross-scene generalization capability and thus the possibility of instant rendering on new scenes.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Ye Yuan , Souvik Kundu , Shang Wu , Shunyao Zhang , Yingyan Celine Lin

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Rendering novel views from captured multi-view images has made considerable progress since the emergence of the neural radiance field. This paper aims to further advance the quality of view synthesis by proposing a novel approach dubbed the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Kang Han , Wei Xiang
‹ Prev 1 8 9 10 Next ›