English
Related papers

Related papers: Real-Time Neural Rasterization for Large Scenes

200 papers

Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand. Existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhuopeng Li , Chenming Wu , Liangjun Zhang , Jianke Zhu

We use neural radiance fields (NeRFs) to build interactive 3D environments from large-scale visual captures spanning buildings or even multiple city blocks collected primarily from drones. In contrast to single object scenes (on which NeRFs…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Haithem Turki , Deva Ramanan , Mahadev Satyanarayanan

Structure from motion (SfM) enables us to reconstruct a scene via casual capture from cameras at different viewpoints, and novel view synthesis (NVS) allows us to render a captured scene from a new viewpoint. Both are hard with casual…

Neural rendering has emerged as a powerful paradigm for synthesizing images, offering many benefits over classical rendering by using neural networks to reconstruct surfaces, represent shapes, and synthesize novel views, either for objects…

Artificial Intelligence · Computer Science 2023-01-30 Saulo Abraham Gante , Juan Irving Vasquez , Marco Antonio Valencia , Mauricio Olguín Carbajal

Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based methods achieve state-of-the-art quality in challenging scenarios such as in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Daniel Duckworth , Rama Gosula , Keisuke Tateno , John Bates , Dominik Kaeser , Federico Tombari

We introduce a scalable framework for novel view synthesis from RGB-D images with largely incomplete scene coverage. While generative neural approaches have demonstrated spectacular results on 2D images, they have not yet achieved similar…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zuoyue Li , Tianxing Fan , Zhenqiang Li , Zhaopeng Cui , Yoichi Sato , Marc Pollefeys , Martin R. Oswald

We present a new system (NPBG++) for the novel view synthesis (NVS) task that achieves high rendering realism with low scene fitting time. Our method efficiently leverages the multiview observations and the point cloud of a static scene to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Ruslan Rakhimov , Andrei-Timotei Ardelean , Victor Lempitsky , Evgeny Burnaev

Existing NeRF-based methods for large scene reconstruction often have limitations in visual quality and rendering speed. While the recent 3D Gaussian Splatting works well on small-scale and object-centric scenes, scaling it up to large…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiaqi Lin , Zhihao Li , Xiao Tang , Jianzhuang Liu , Shiyong Liu , Jiayue Liu , Yangdi Lu , Xiaofei Wu , Songcen Xu , Youliang Yan , Wenming Yang

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

We present a neural rendering framework that maps a voxelized scene into a high quality image. Highly-textured objects and scene element interactions are realistically rendered by our method, despite having a rough representation as an…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Konstantinos Rematas , Vittorio Ferrari

Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic images from hand-crafted scene representations. However, the…

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Novel view synthesis techniques predominantly utilize RGB cameras, inheriting their limitations such as the need for sufficient lighting, susceptibility to motion blur, and restricted dynamic range. In contrast, event cameras are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sohaib Zahid , Viktor Rudnev , Eddy Ilg , Vladislav Golyanik

We revisit NPBG, the popular approach to novel view synthesis that introduced the ubiquitous point feature neural rendering paradigm. We are interested in particular in data-efficient learning with fast view synthesis. We achieve this…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Shubhendu Jena , Franck Multon , Adnane Boukhayma

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Scene-level novel view synthesis (NVS) is fundamental to many vision and graphics applications. Recently, pose-conditioned diffusion models have led to significant progress by extracting 3D information from 2D foundation models, but these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Joseph Tung , Gene Chou , Ruojin Cai , Guandao Yang , Kai Zhang , Gordon Wetzstein , Bharath Hariharan , Noah Snavely

Recent implicit neural representations have shown great results for novel view synthesis. However, existing methods require expensive per-scene optimization from many views hence limiting their application to real-world unbounded urban…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Muhammad Zubair Irshad , Sergey Zakharov , Katherine Liu , Vitor Guizilini , Thomas Kollar , Adrien Gaidon , Zsolt Kira , Rares Ambrus

We present a large-scale synthetic dataset for novel view synthesis consisting of ~300k images rendered from nearly 2000 complex scenes using high-quality ray tracing at high resolution (1600 x 1600 pixels). The dataset is orders of…

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Novel view synthesis (NVS) seeks to render photorealistic, 3D-consistent images of a scene from unseen camera poses given only a sparse set of posed views. Existing deterministic networks render observed regions quickly but blur unobserved…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Thanh-Tung Le , Tuan Pham , Tung Nguyen , Deying Kong , Xiaohui Xie , Stephan Mandt