English
Related papers

Related papers: End-to-end View Synthesis via NeRF Attention

200 papers

In recent years, the performance of novel view synthesis using perspective images has dramatically improved with the advent of neural radiance fields (NeRF). This study proposes two novel techniques that effectively build NeRF for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Takashi Otonari , Satoshi Ikehata , Kiyoharu Aizawa

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Nagabhushan Somraj

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov

In this paper, we present a novel and effective framework, named 4K-NeRF, to pursue high fidelity view synthesis on the challenging scenarios of ultra high resolutions, building on the methodology of neural radiance fields (NeRF). The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhongshu Wang , Lingzhi Li , Zhen Shen , Li Shen , Liefeng Bo

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

The neural radiance field (NeRF) achieved remarkable success in modeling 3D scenes and synthesizing high-fidelity novel views. However, existing NeRF-based methods focus more on the make full use of the image resolution to generate novel…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yuqi Han , Tao Yu , Xiaohang Yu , Yuwang Wang , Qionghai Dai

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

We study the problem of novel view synthesis of objects from a single image. Existing methods have demonstrated the potential in single-view view synthesis. However, they still fail to recover the fine appearance details, especially in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Xingyi Li , Chaoyi Hong , Yiran Wang , Zhiguo Cao , Ke Xian , Guosheng Lin

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

Consumer light-field (LF) cameras suffer from a low or limited resolution because of the angular-spatial trade-off. To alleviate this drawback, we propose a novel learning-based approach utilizing attention mechanism to synthesize novel…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 M. Shahzeb Khan Gul , Umair Mukati , Michel Bätz , Søren Forchhammer , Joachim Keinert

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Novel view synthesis (NVS) is a challenge in computer vision and graphics, focusing on generating realistic images of a scene from unobserved camera poses, given a limited set of authentic input images. Neural radiance fields (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Austin Peng

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

We present a method to synthesize novel views from a single $360^\circ$ panorama image based on the neural radiance field (NeRF). Prior studies in a similar setting rely on the neighborhood interpolation capability of multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shreyas Kulkarni , Peng Yin , Sebastian Scherer

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Thu Nguyen-Phuoc , Feng Liu , Lei Xiao

Existing neural radiance fields (NeRF)-based novel view synthesis methods for large-scale outdoor scenes are mainly built on a single altitude. Moreover, they often require a priori camera shooting height and scene scope, leading to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Jingfeng Guo , Xiaohan Zhang , Baozhu Zhao , Qi Liu