English
Related papers

Related papers: NerfDiff: Single-image View Synthesis with NeRF-gu…

200 papers

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

We present DiffPortrait3D, a conditional diffusion model that is capable of synthesizing 3D-consistent photo-realistic novel views from as few as a single in-the-wild portrait. Specifically, given a single RGB input, we aim to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuming Gu , You Xie , Hongyi Xu , Guoxian Song , Yichun Shi , Di Chang , Jing Yang , Linjie Luo

We study the problem of novel view synthesis of objects from a single image. Existing methods have demonstrated the potential in single-view view synthesis. However, they still fail to recover the fine appearance details, especially in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Xingyi Li , Chaoyi Hong , Yiran Wang , Zhiguo Cao , Ke Xian , Guosheng Lin

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

Neural Radiance Field (NeRF) has broken new ground in the novel view synthesis due to its simple concept and state-of-the-art quality. However, it suffers from severe performance degradation unless trained with a dense set of images with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Seunghyeon Seo , Donghoon Han , Yeonjin Chang , Nojun Kwak

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view images. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Zixiong Huang , Qi Chen , Libo Sun , Yifan Yang , Naizhou Wang , Mingkui Tan , Qi Wu

Pose-conditioned convolutional generative models struggle with high-quality 3D-consistent image generation from single-view datasets, due to their lack of sufficient 3D priors. Recently, the integration of Neural Radiance Fields (NeRFs) and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mohamad Shahbazi , Evangelos Ntavelis , Alessio Tonioni , Edo Collins , Danda Pani Paudel , Martin Danelljan , Luc Van Gool

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D representation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

The 3D-aware image synthesis focuses on conserving spatial consistency besides generating high-resolution images with fine details. Recently, Neural Radiance Field (NeRF) has been introduced for synthesizing novel views with low…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiwook Kim , Minhyeok Lee

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Novel view synthesis from low dynamic range (LDR) blurry images, which are common in the wild, struggles to recover high dynamic range (HDR) and sharp 3D representations in extreme lighting conditions. Although existing methods employ event…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yunshan Qi , Lin Zhu , Nan Bao , Yifan Zhao , Jia Li

Neural Radiance Fields (NeRFs) have demonstrated prominent performance in novel view synthesis. However, their input heavily relies on image acquisition under normal light conditions, making it challenging to learn accurate scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Min Wang , Xin Huang , Guoqing Zhou , Qifeng Guo , Qing Wang

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

Neural Radiance Fields (NeRFs) have shown remarkable success in synthesizing photorealistic views from multi-view images of static scenes, but face challenges in dynamic, real-world environments with distractors like moving objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Weining Ren , Zihan Zhu , Boyang Sun , Jiaqi Chen , Marc Pollefeys , Songyou Peng

In dynamic Neural Radiance Fields (NeRF) systems, state-of-the-art novel view synthesis methods often fail under significant viewpoint deviations, producing unstable and unrealistic renderings. To address this, we introduce Expanded Dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Le Jiang , Shaotong Zhu , Yedi Luo , Shayda Moezzi , Sarah Ostadabbas