English
Related papers

Related papers: Re-Nerfing: Improving Novel View Synthesis through…

200 papers

Neural Radiance Field (NeRF) and 3D Gaussian Splatting (3DGS) have noticeably advanced photo-realistic novel view synthesis using images from densely spaced camera viewpoints. However, these methods struggle in few-shot scenarios due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yulong Zheng , Zicheng Jiang , Shengfeng He , Yandu Sun , Junyu Dong , Huaidong Zhang , Yong Du

In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhicheng Lu , Xiang Guo , Le Hui , Tianrui Chen , Min Yang , Xiao Tang , Feng Zhu , Yuchao Dai

Per-scene optimization methods such as 3D Gaussian Splatting provide state-of-the-art novel view synthesis quality but extrapolate poorly to under-observed areas. Methods that leverage generative priors to correct artifacts in these areas…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Riccardo de Lutio , Tobias Fischer , Yen-Yu Chang , Yuxuan Zhang , Jay Zhangjie Wu , Xuanchi Ren , Tianchang Shen , Katarina Tothova , Zan Gojcic , Haithem Turki

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhang Chen , Anpei Chen , Guli Zhang , Chengyuan Wang , Yu Ji , Kiriakos N. Kutulakos , Jingyi Yu

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

We present SetDiff, a geometry-grounded multi-view diffusion framework that enhances novel-view renderings produced by 3D Gaussian Splatting. Our method integrates explicit 3D priors, pixel-aligned coordinate maps and pose-aware Plucker ray…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Farhad G. Zanjani , Hong Cai , Amirhossein Habibian

Novel view synthesis is a long-standing problem in machine learning and computer vision. Significant progress has recently been made in developing neural scene representations and rendering techniques that synthesize photorealistic images…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Alexander W. Bergman , Petr Kellnhofer , Gordon Wetzstein

Novel View Synthesis (NVS) can reconstruct scenes from multi-view images and synthesize novel images from new viewpoints, which provides technical support for tasks such as target recognition and environmental perception. Aerial remote…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yiling Yao , Bing Zhang , Wenjuan Zhang , Lianru Gao , Dailiang Peng , Bocheng Li , Yaning Wang , Bowen Wang

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

Neural radiance fields (NeRF) methods have demonstrated impressive novel view synthesis performance. The core approach is to render individual rays by querying a neural network at points sampled along the ray to obtain the density and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Relja Arandjelović , Andrew Zisserman

We address the problem of novel view synthesis (NVS) from a few sparse source view images. Conventional image-based rendering methods estimate scene geometry and synthesize novel views in two separate steps. However, erroneous geometry…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yujiao Shi , Hongdong Li , Xin Yu

Recently, 3D Gaussian Splatting (3DGS) has exceled in novel view synthesis (NVS) with its real-time rendering capabilities and superior quality. However, it faces challenges for high-resolution novel view synthesis (HRNVS) due to the coarse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Shiyun Xie , Zhiru Wang , Xu Wang , Yinghao Zhu , Chengwei Pan , Xiwang Dong

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

Neural Radiance Fields (NeRFs) have achieved impressive results in novel view synthesis and surface reconstruction tasks. However, their performance suffers under challenging scenarios with sparse input views. We present CorresNeRF, a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yixing Lao , Xiaogang Xu , Zhipeng Cai , Xihui Liu , Hengshuang Zhao

We tackle the ill-posed inverse rendering problem in 3D reconstruction with a Neural Radiance Field (NeRF) approach informed by Physics-Based Rendering (PBR) theory, named PBR-NeRF. Our method addresses a key limitation in most NeRF and 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Sean Wu , Shamik Basu , Tim Broedermann , Luc Van Gool , Christos Sakaridis

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu