English
Related papers

Related papers: NerfBaselines: Consistent and Reproducible Evaluat…

200 papers

Novel view synthesis (NVS) has advanced with generative modeling, enabling photorealistic image generation. In few-shot NVS, where only a few input views are available, existing methods often assume equal importance for all input views…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Alex Berian , JhihYang Wu , Daniel Brignac , Natnael Daba , Abhijit Mahalanobis

The task of novel view synthesis aims to generate unseen perspectives of an object or scene from a limited set of input images. Nevertheless, synthesizing novel views from a single image still remains a significant challenge in the realm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yifan Jiang , Hao Tang , Jen-Hao Rick Chang , Liangchen Song , Zhangyang Wang , Liangliang Cao

3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particularly in mirrors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiarui Meng , Haijie Li , Yanmin Wu , Qiankun Gao , Shuzhou Yang , Jian Zhang , Siwei Ma

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

Recent advancements in 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have achieved impressive results in real-time 3D reconstruction and novel view synthesis. However, these methods struggle in large-scale, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Niluthpol Chowdhury Mithun , Tuan Pham , Qiao Wang , Ben Southall , Kshitij Minhas , Bogdan Matei , Stephan Mandt , Supun Samarasekera , Rakesh Kumar

Novel view synthesis from limited observations remains an important and persistent task. However, high efficiency in existing NeRF-based few-shot view synthesis is often compromised to obtain an accurate 3D representation. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zehao Zhu , Zhiwen Fan , Yifan Jiang , Zhangyang Wang

Neural radiance fields (NeRFs) have gained popularity in the autonomous driving (AD) community. Recent methods show NeRFs' potential for closed-loop simulation, enabling testing of AD systems, and as an advanced training data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Adam Tonderski , Carl Lindström , Georg Hess , William Ljungbergh , Lennart Svensson , Christoffer Petersson

Existing real-time RGB-D reconstruction approaches, like Kinect Fusion, lack real-time photo-realistic visualization. This is due to noisy, oversmoothed or incomplete geometry and blurry textures which are fused from imperfect depth maps…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Laura Fink , Darius Rückert , Linus Franke , Joachim Keinert , Marc Stamminger

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Recently, 3D Gaussian Splatting (3DGS) has emerged as a powerful alternative to NeRF-based approaches, enabling real-time, high-quality novel view synthesis through explicit, optimizable 3D Gaussians. However, 3DGS suffers from significant…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zipeng Wang , Dan Xu

The long-standing problem of novel view synthesis has many applications, notably in sports broadcasting. Photorealistic novel view synthesis of soccer actions, in particular, is of enormous interest to the broadcast industry. Yet only a few…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Sacha Lewin , Maxime Vandegar , Thomas Hoyoux , Olivier Barnich , Gilles Louppe

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Content creation, central to applications such as virtual reality, can be a tedious and time-consuming. Recent image synthesis methods simplify this task by offering tools to generate new views from as little as a single input image, or by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Tewodros Habtegebrial , Varun Jampani , Orazio Gallo , Didier Stricker

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Christina Tsalicoglou , Keisuke Tateno , Jonathan T. Barron , Federico Tombari

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

This paper presents BioNeRF, a biologically plausible architecture that models scenes in a 3D representation and synthesizes new views through radiance fields. Since NeRF relies on the network weights to store the scene's 3-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Leandro A. Passos , Douglas Rodrigues , Danilo Jodas , Kelton A. P. Costa , Ahsan Adeel , João Paulo Papa

First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liqi Yan , Qifan Wang , Junhan Zhao , Qiang Guan , Zheng Tang , Jianhui Zhang , Dongfang Liu

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab