English
Related papers

Related papers: DGNR: Density-Guided Neural Point Rendering of Lar…

200 papers

Unsupervised learning with generative models has the potential of discovering rich representations of 3D scenes. While geometric deep learning has explored 3D-structure-aware representations of scene geometry, these models typically require…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Vincent Sitzmann , Michael Zollhöfer , Gordon Wetzstein

Developing deep neural networks to generate 3D scenes is a fundamental problem in neural synthesis with immediate applications in architectural CAD, computer graphics, as well as in generating virtual robot training environments. This task…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Haitao Yang , Zaiwei Zhang , Siming Yan , Haibin Huang , Chongyang Ma , Yi Zheng , Chandrajit Bajaj , Qixing Huang

Neural Radiance Fields (NeRF) have become an increasingly popular representation to capture high-quality appearance and shape of scenes and objects. However, learning generalizable NeRF priors over categories of scenes or objects has been…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bipasha Sen , Gaurav Singh , Aditya Agarwal , Rohith Agaram , K Madhava Krishna , Srinath Sridhar

Being able to rapidly respond to the changing scenes and traffic situations by generating feasible local paths is of pivotal importance for car autonomy. We propose to train a deep neural network (DNN) to plan feasible and nearly-optimal…

Robotics · Computer Science 2023-01-26 Piotr Kicki , Tomasz Gawron , Krzysztof Ćwian , Mete Ozay , Piotr Skrzypczyński

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

Due to the ability to synthesize high-quality novel views, Neural Radiance Fields (NeRF) have been recently exploited to improve visual localization in a known environment. However, the existing methods mostly utilize NeRFs for data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Boming Zhao , Luwei Yang , Mao Mao , Hujun Bao , Zhaopeng Cui

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural radiance field to RGB images. However, NeRF requires querying a deep Multi-Layer Perceptron (MLP) millions of times, leading to slow rendering times,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Christian Reiser , Songyou Peng , Yiyi Liao , Andreas Geiger

Novel View Synthesis (NVS) for street scenes play a critical role in the autonomous driving simulation. The current mainstream technique to achieve it is neural rendering, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zhongrui Yu , Haoran Wang , Jinze Yang , Hanzhang Wang , Zeke Xie , Yunfeng Cai , Jiale Cao , Zhong Ji , Mingming Sun

We present GeoNeRF, a generalizable photorealistic novel view synthesis method based on neural radiance fields. Our approach consists of two main stages: a geometry reasoner and a renderer. To render a novel view, the geometry reasoner…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Mohammad Mahdi Johari , Yann Lepoittevin , François Fleuret

3D surface reconstruction from images is essential for numerous applications. Recently, Neural Radiance Fields (NeRFs) have emerged as a promising framework for 3D modeling. However, NeRFs require accurate camera poses as input, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yiyang Chen , Siyan Dong , Xulong Wang , Lulu Cai , Youyi Zheng , Yanchao Yang

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou

We address the task of view synthesis, generating novel views of a scene given a set of images as input. In many recent works such as NeRF (Mildenhall et al., 2020), the scene geometry is parameterized using neural implicit representations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yiming Zuo , Jia Deng

Neural radiance fields (NeRF) has achieved outstanding performance in modeling 3D objects and controlled scenes, usually under a single scale. In this work, we focus on multi-scale cases where large changes in imagery are observed at…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Yuanbo Xiangli , Linning Xu , Xingang Pan , Nanxuan Zhao , Anyi Rao , Christian Theobalt , Bo Dai , Dahua Lin

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

Capturing and rendering novel views of complex real-world scenes is a long-standing problem in computer graphics and vision, with applications in augmented and virtual reality, immersive experiences and 3D photography. The advent of deep…

Graphics · Computer Science 2024-08-09 Ravi Ramamoorthi

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Neural Radiance Fields (NeRFs) have shown great potential in modeling 3D scenes. Dynamic NeRFs extend this model by capturing time-varying elements, typically using deformation fields. The existing dynamic NeRFs employ a similar Eulerian…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ancheng Lin , Yusheng Xiang , Jun Li , Mukesh Prasad

Large scale 3D scene reconstruction is important for applications such as virtual reality and simulation. Existing neural rendering approaches (e.g., NeRF, 3DGS) have achieved realistic reconstructions on large scenes, but optimize per…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yun Chen , Jingkang Wang , Ze Yang , Sivabalan Manivasagam , Raquel Urtasun