English
Related papers

Related papers: VR-NeRF: High-Fidelity Virtualized Walkable Spaces

200 papers

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Junyi Zeng , Chong Bao , Rui Chen , Zilong Dong , Guofeng Zhang , Hujun Bao , Zhaopeng Cui

Recent techniques for real-time view synthesis have rapidly advanced in fidelity and speed, and modern methods are capable of rendering near-photorealistic scenes at interactive frame rates. At the same time, a tension has arisen between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Daniel Duckworth , Peter Hedman , Christian Reiser , Peter Zhizhin , Jean-François Thibert , Mario Lučić , Richard Szeliski , Jonathan T. Barron

We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene. Given a single observed RGB image of the target, we can predict the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yunzhi Lin , Thomas Müller , Jonathan Tremblay , Bowen Wen , Stephen Tyree , Alex Evans , Patricio A. Vela , Stan Birchfield

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

Efficient and accurate 3D reconstruction is essential for applications in cultural heritage. This study addresses the challenge of visualizing objects within large-scale scenes at a high level of detail (LOD) using Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Quoc-Anh Bui , Gilles Rougeron , Géraldine Morin , Simone Gasparini

Neural Radiance Fields (NeRF) has demonstrated its superior capability to represent 3D geometry but require accurately precomputed camera poses during training. To mitigate this requirement, existing methods jointly optimize camera poses…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hoang Chuong Nguyen , Wei Mao , Jose M. Alvarez , Miaomiao Liu

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

We present a super-fast convergence approach to reconstructing the per-scene radiance field from a set of images that capture the scene with known poses. This task, which is often applied to novel view synthesis, is recently revolutionized…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Cheng Sun , Min Sun , Hwann-Tzong Chen

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

In rapidly-evolving domains such as autonomous driving, the use of multiple sensors with different modalities is crucial to ensure high operational precision and stability. To correctly exploit the provided information by each sensor in a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Dor Verbin , Pratul P. Srinivasan , Peter Hedman , Ben Mildenhall , Benjamin Attal , Richard Szeliski , Jonathan T. Barron

Hyperspectral Imagery (HSI) has been used in many applications to non-destructively determine the material and/or chemical compositions of samples. There is growing interest in creating 3D hyperspectral reconstructions, which could provide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Gerry Chen , Sunil Kumar Narayanan , Thomas Gautier Ottou , Benjamin Missaoui , Harsh Muriki , Cédric Pradalier , Yongsheng Chen

Neural Radiance Fields (NeRF), an AI-driven approach for 3D view reconstruction, has demonstrated impressive performance, sparking active research across fields. As a result, a range of advanced NeRF models has emerged, leading on-device…

Hardware Architecture · Computer Science 2025-05-13 Seock-Hwan Noh , Banseok Shin , Jeik Choi , Seungpyo Lee , Jaeha Kung , Yeseong Kim

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue

NeRF-based techniques fit wide and deep multi-layer perceptrons (MLPs) to a continuous radiance field that can be rendered from any unseen viewpoint. However, the lack of surface and normals definition and high rendering times limit their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Stefano Esposito , Daniele Baieri , Stefan Zellmann , André Hinkenjann , Emanuele Rodolà

This paper proposes a hybrid radiance field representation for unbounded immersive light field reconstruction which supports high-quality rendering and aggressive view extrapolation. The key idea is to first formally separate the foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Xiaohang Yu , Haoxiang Wang , Yuqi Han , Lei Yang , Tao Yu , Qionghai Dai

Neural Radiance Fields (NeRFs) can be dramatically accelerated by spatial grid representations. However, they do not explicitly reason about scale and so introduce aliasing artifacts when reconstructing scenes captured at different camera…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Haithem Turki , Michael Zollhöfer , Christian Richardt , Deva Ramanan

A practical benefit of implicit visual representations like Neural Radiance Fields (NeRFs) is their memory efficiency: large scenes can be efficiently stored and shared as small neural nets instead of collections of images. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jiading Fang , Shengjie Lin , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Adrien Gaidon , Gregory Shakhnarovich , Matthew R. Walter