English
Related papers

Related papers: PCM-NeRF: Probabilistic Camera Modeling for Neural…

200 papers

The neural radiance field (NeRF) for realistic novel view synthesis requires camera poses to be pre-acquired by a structure-from-motion (SfM) approach. This two-stage strategy is not convenient to use and degrades the performance because…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shu Chen , Yang Zhang , Yaxin Xu , Beiji Zou

Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Miriam Jäger , Patrick Hübner , Dennis Haitz , Boris Jutzi

Learning accurate scene reconstruction without pose priors in neural radiance fields is challenging due to inherent geometric ambiguity. Recent development either relies on correspondence priors for regularization or uses off-the-shelf flow…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xunzhi Zheng , Dan Xu

We present VERF, a collection of two methods (VERF-PnP and VERF-Light) for providing runtime assurance on the correctness of a camera pose estimate of a monocular camera without relying on direct depth measurements. We leverage the ability…

Robotics · Computer Science 2023-08-14 Dominic Maggio , Courtney Mario , Luca Carlone

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Axel Levy , Mark Matthews , Matan Sela , Gordon Wetzstein , Dmitry Lagun

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau

We address the estimation of the 6D pose of an unknown target spacecraft relative to a monocular camera, a key step towards the autonomous rendezvous and proximity operations required by future Active Debris Removal missions. We present a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Antoine Legrand , Renaud Detry , Christophe De Vleeschouwer

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

This paper presents a neural incremental Structure-from-Motion (SfM) approach, Level-S$^2$fM, which estimates the camera poses and scene geometry from a set of uncalibrated images by learning coordinate MLPs for the implicit surfaces and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuxi Xiao , Nan Xue , Tianfu Wu , Gui-Song Xia

In this work, we propose a camera self-calibration algorithm for generic cameras with arbitrary non-linear distortions. We jointly learn the geometry of the scene and the accurate camera parameters without any calibration objects. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yoonwoo Jeong , Seokjun Ahn , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Spacecraft pose estimation networks require tens of thousands of CAD-rendered images to be trained. This reliance on synthetic CAD data (i) limits applicability to targets with reliable geometry prior, excluding uncooperative or poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Antoine Legrand , Renaud Detry , Christophe De Vleeschouwer

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

A critical obstacle preventing NeRF models from being deployed broadly in the wild is their reliance on accurate camera poses. Consequently, there is growing interest in extending NeRF models to jointly optimize camera poses and scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Zezhou Cheng , Carlos Esteves , Varun Jampani , Abhishek Kar , Subhransu Maji , Ameesh Makadia

Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is the case with…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nishant Jain , Suryansh Kumar , Luc Van Gool

Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision. Existing deep learning approaches for 6D pose estimation typically rely on the assumption of availability of 3D object models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Fu Li , Hao Yu , Ivan Shugurov , Benjamin Busam , Shaowu Yang , Slobodan Ilic

Recently, Neural Radiance Field (NeRF) has shown great success in rendering novel-view images of a given scene by learning an implicit representation with only posed RGB images. NeRF and relevant neural field methods (e.g., neural surface…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zeke Xie , Xindi Yang , Yujie Yang , Qi Sun , Yixiang Jiang , Haoran Wang , Yunfeng Cai , Mingming Sun