English
Related papers

Related papers: Differentiable Point-Based Radiance Fields for Eff…

200 papers

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. Despite numerous task-specific methods, developing a comprehensive model remains challenging. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Hansheng Chen , Jiatao Gu , Anpei Chen , Wei Tian , Zhuowen Tu , Lingjie Liu , Hao Su

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tristan Aumentado-Armstrong , Ashkan Mirzaei , Marcus A. Brubaker , Jonathan Kelly , Alex Levinshtein , Konstantinos G. Derpanis , Igor Gilitschenski

Generating free-viewpoint videos is critical for immersive VR/AR experience but recent neural advances still lack the editing ability to manipulate the visual perception for large dynamic scenes. To fill this gap, in this paper we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Jiakai Zhang , Xinhang Liu , Xinyi Ye , Fuqiang Zhao , Yanshun Zhang , Minye Wu , Yingliang Zhang , Lan Xu , Jingyi Yu

Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Liangchen Song , Anpei Chen , Zhong Li , Zhang Chen , Lele Chen , Junsong Yuan , Yi Xu , Andreas Geiger

Neural Radiance Field (NeRF) has broken new ground in the novel view synthesis due to its simple concept and state-of-the-art quality. However, it suffers from severe performance degradation unless trained with a dense set of images with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Seunghyeon Seo , Donghoon Han , Yeonjin Chang , Nojun Kwak

Neural radiance fields (NeRFs) are a powerful tool for implicit scene representations, allowing for differentiable rendering and the ability to make predictions about unseen viewpoints. There has been growing interest in object and…

Robotics · Computer Science 2024-11-14 Boxuan Zhang , Lindsay Kleeman , Michael Burke

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Capturing and rendering novel views of complex real-world scenes is a long-standing problem in computer graphics and vision, with applications in augmented and virtual reality, immersive experiences and 3D photography. The advent of deep…

Graphics · Computer Science 2024-08-09 Ravi Ramamoorthi

Recently, differentiable volume rendering in neural radiance fields (NeRF) has gained a lot of popularity, and its variants have attained many impressive results. However, existing methods usually assume the scene is a homogeneous volume so…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jen-I Pan , Jheng-Wei Su , Kai-Wen Hsiao , Ting-Yu Yen , Hung-Kuo Chu

3D Gaussian splatting (3DGS) is an innovative rendering technique that surpasses the neural radiance field (NeRF) in both rendering speed and visual quality by leveraging an explicit 3D scene representation. Existing 3DGS approaches require…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Lintao Xiang , Hongpei Zheng , Yating Huang , Qijun Yang , Hujun Yin

In dynamic Neural Radiance Fields (NeRF) systems, state-of-the-art novel view synthesis methods often fail under significant viewpoint deviations, producing unstable and unrealistic renderings. To address this, we introduce Expanded Dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Le Jiang , Shaotong Zhu , Yedi Luo , Shayda Moezzi , Sarah Ostadabbas

We present a method to automatically compute correct gradients with respect to geometric scene parameters in neural SDF renderers. Recent physically-based differentiable rendering techniques for meshes have used edge-sampling to handle…

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising diffusion probabilistic models. While existing diffusion-based methods operate on images, latent codes, or point cloud data, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Norman Müller , Yawar Siddiqui , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Matthias Nießner

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan