English
Related papers

Related papers: NARVis: Neural Accelerated Rendering for Real-Time…

200 papers

Neural Radiance Fields (NeRF) have emerged as a paradigm-shifting methodology for the photorealistic rendering of objects and environments, enabling the synthesis of novel viewpoints with remarkable fidelity. This is accomplished through…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Peng Tu , Xun Zhou , Mingming Wang , Xiaojun Yang , Bo Peng , Ping Chen , Xiu Su , Yawen Huang , Yefeng Zheng , Chang Xu

Novel-view synthesis with sparse input views is important for real-world applications like AR/VR and autonomous driving. Recent methods have integrated depth information into NeRFs for sparse input synthesis, leveraging depth prior for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shuai Guo , Qiuwen Wang , Yijie Gao , Rong Xie , Li Song

Rendering high-fidelity images from sparse point clouds is still challenging. Existing learning-based approaches suffer from either hole artifacts, missing details, or expensive computations. In this paper, we propose a novel framework to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Jiaxu Wang , Ziyi Zhang , Junhao He , Renjing Xu

Implicit Neural Point Cloud (INPC) is a recent hybrid representation that combines the expressiveness of neural fields with the efficiency of point-based rendering, achieving state-of-the-art image quality in novel view synthesis. However,…

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Saeejith Nair , Yuhao Chen , Mohammad Javad Shafiee , Alexander Wong

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

We address the task of view synthesis, generating novel views of a scene given a set of images as input. In many recent works such as NeRF (Mildenhall et al., 2020), the scene geometry is parameterized using neural implicit representations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yiming Zuo , Jia Deng

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Recently, 3D Gaussian splatting (3D-GS) has gained popularity in novel-view scene synthesis. It addresses the challenges of lengthy training times and slow rendering speeds associated with Neural Radiance Fields (NeRFs). Through rapid,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Sharath Girish , Kamal Gupta , Abhinav Shrivastava

The modern computer graphics pipeline can synthesize images at remarkable visual quality; however, it requires well-defined, high-quality 3D content as input. In this work, we explore the use of imperfect 3D content, for instance, obtained…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Justus Thies , Michael Zollhöfer , Matthias Nießner

While Neural Radiance Fields (NeRFs) have demonstrated exceptional quality, their protracted training duration remains a limitation. Generalizable and MVS-based NeRFs, although capable of mitigating training time, often incur tradeoffs in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Chih-Hai Su , Chih-Yao Hu , Shr-Ruei Tsai , Jie-Ying Lee , Chin-Yang Lin , Yu-Lun Liu

Meeting online is becoming the new normal. Creating an immersive experience for online meetings is a necessity towards more diverse and seamless environments. Efficient photorealistic rendering of human 3D dynamics is the core of immersive…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Chuanyue Shen , Letian Zhang , Zhangsihao Yang , Masood Mortazavi , Xiyun Song , Liang Peng , Heather Yu

Since their introduction in 2020, Neural Radiance Fields (NeRFs) have taken the computer vision community by storm. They provide a multi-view representation of a scene or object that is ideal for eXtended Reality (XR) applications and for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Derek Jacoby , Donglin Xu , Weder Ribas , Minyi Xu , Ting Liu , Vishwanath Jayaraman , Mengdi Wei , Emma De Blois , Yvonne Coady

We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural rendering. Motivated by the fact that informative point cloud features should be able to encode rich geometry and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Di Huang , Sida Peng , Tong He , Honghui Yang , Xiaowei Zhou , Wanli Ouyang

Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Iryna Repinetska , Anna Hilsmann , Peter Eisert

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

A practical benefit of implicit visual representations like Neural Radiance Fields (NeRFs) is their memory efficiency: large scenes can be efficiently stored and shared as small neural nets instead of collections of images. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jiading Fang , Shengjie Lin , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Adrien Gaidon , Gregory Shakhnarovich , Matthew R. Walter

Neural radiance field (NeRF), in particular its extension by instant neural graphics primitives, is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ke Li , Tim Rolff , Susanne Schmidt , Reinhard Bacher , Simone Frintrop , Wim Leemans , Frank Steinicke