English
Related papers

Related papers: NuRF: Nudging the Particle Filter in Radiance Fiel…

200 papers

Recent progress in large-scale scene rendering has yielded Neural Radiance Fields (NeRF)-based models with an impressive ability to synthesize scenes across small objects and indoor scenes. Nevertheless, extending this idea to large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Xiaohan Zhang , Yukui Qiu , Zhenyu Sun , Qi Liu

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Learning a 3D representation of a scene has been a challenging problem for decades in computer vision. Recent advances in implicit neural representation from images using neural radiance fields(NeRF) have shown promising results. Some of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Andrew I. Comport

Accurate 3D object pose estimation is key to enabling many robotic applications that involve challenging object interactions. In this work, we show that the density field created by a state-of-the-art efficient radiance field reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Marwan Taher , Ignacio Alzugaray , Andrew J. Davison

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

In the realm of digital situational awareness during disaster situations, accurate digital representations, like 3D models, play an indispensable role. To ensure the safety of rescue teams, robotic platforms are often deployed to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Hartmut Surmann , Niklas Digakis , Jan-Nicklas Kremer , Julien Meine , Max Schulte , Niklas Voigt

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural radiance field to RGB images. However, NeRF requires querying a deep Multi-Layer Perceptron (MLP) millions of times, leading to slow rendering times,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Christian Reiser , Songyou Peng , Yiyi Liao , Andreas Geiger

Given the image collection of an object, we aim at building a real-time image-based pose estimation method, which requires neither its CAD model nor hours of object-specific training. Recent NeRF-based methods provide a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ronghan Chen , Yang Cong , Yu Ren

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

Rendering moving human bodies at free viewpoints only from a monocular video is quite a challenging problem. The information is too sparse to model complicated human body structures and motions from both view and pose dimensions. Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Taoran Yi , Jiemin Fang , Xinggang Wang , Wenyu Liu

Neural Radiance Fields (NeRF) have shown promise in generating realistic novel views from sparse scene images. However, existing NeRF approaches often encounter challenges due to the lack of explicit 3D supervision and imprecise camera…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Kun Wang , Zhiqiang Yan , Huang Tian , Zhenyu Zhang , Xiang Li , Jun Li , Jian Yang

Modelling individual objects in a scene as Neural Radiance Fields (NeRFs) provides an alternative geometric scene representation that may benefit downstream robotics tasks such as scene understanding and object manipulation. However, we…

Robotics · Computer Science 2022-10-10 Jad Abou-Chakra , Feras Dayoub , Niko Sünderhauf

Neural Radiance Fields (NeRFs) have unmatched fidelity on large, real-world scenes. A common approach for scaling NeRFs is to partition the scene into regions, each of which is assigned its own parameters. When implemented naively, such an…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Clinton Wang , Peter Hedman , Polina Golland , Jonathan T. Barron , Daniel Duckworth

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

We present a novel monocular localization framework by jointly training deep learning-based depth prediction and Bayesian filtering-based pose reasoning. The proposed cross-modal framework significantly outperforms deep learning-only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Priyesh Shukla , Sureshkumar S. , Alex C. Stutts , Sathya Ravi , Theja Tulabandhula , Amit R. Trivedi

Many real-world 3D reconstruction applications demand photorealism and metric accuracy across unbounded, complex scenes with challenging lighting and imperfect captures that current Neural Radiance Field (NeRF) pipelines only partly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Vladislav Polianskii , Elijs Dima , Isabel Salmerón Marazuela , Gergő László Nagy , Sigurdur Sverrisson , Volodya Grancharov

We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object category models from collections of input images. In contrast to previous work, we are able to do this whilst simultaneously separating foreground…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Christopher Xie , Keunhong Park , Ricardo Martin-Brualla , Matthew Brown

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Recently, neural radiance field (NeRF) has shown remarkable performance in novel view synthesis and 3D reconstruction. However, it still requires abundant high-quality images, limiting its applicability in real-world scenarios. To overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaewoo Jung , Jisang Han , Jiwon Kang , Seongchan Kim , Min-Seop Kwak , Seungryong Kim