English
Related papers

Related papers: Marrying NeRF with Feature Matching for One-step P…

200 papers

This paper tackles the simultaneous optimization of pose and Neural Radiance Fields (NeRF). Departing from the conventional practice of using explicit global representations for camera pose, we propose a novel overparameterized…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Shin-Fang Chng , Ravi Garg , Hemanth Saratchandran , Simon Lucey

3D pose estimation from a single 2D image is an important and challenging task in computer vision with applications in autonomous driving, robot manipulation and augmented reality. Since 3D pose is a continuous quantity, a natural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Siddharth Mahendran , Haider Ali , Rene Vidal

Estimating neural radiance fields (NeRFs) from "ideal" images has been extensively studied in the computer vision community. Most approaches assume optimal illumination and slow camera motion. These assumptions are often violated in robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Simon Klenk , Lukas Koestler , Davide Scaramuzza , Daniel Cremers

To determine the 3D orientation and 3D location of objects in the surroundings of a camera mounted on a robot or mobile device, we developed two powerful algorithms in object detection and temporal tracking that are combined seamlessly for…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 David Joseph Tan , Nassir Navab , Federico Tombari

Neural Radiance Fields (NeRF) have recently gained a surge of interest within the computer vision community for its power to synthesize photorealistic novel views of real-world scenes. One limitation of NeRF, however, is its requirement of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Chen-Hsuan Lin , Wei-Chiu Ma , Antonio Torralba , Simon Lucey

We propose a novel approach for joint 3D multi-object tracking and reconstruction from RGB-D sequences in indoor environments. To this end, we detect and reconstruct objects in each frame while predicting dense correspondences mappings into…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Dominik Schmauser , Zeju Qiu , Norman Müller , Matthias Nießner

Determining the position and orientation of a calibrated camera from a single image with respect to a 3D model is an essential task for many applications. When 2D-3D correspondences can be obtained reliably, perspective-n-point solvers can…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Dylan Campbell , Lars Petersson , Laurent Kneip , Hongdong Li , Stephen Gould

In this work we present a unified method of relative camera pose estimation from points and lines correspondences. Given a set of 2D points and lines correspondences in three views, of which two are known, a method has been developed for…

Robotics · Computer Science 2017-10-19 Ashraf Qadir , Jeremiah Neubert

The task of estimating the 6D pose of an object from RGB images can be broken down into two main steps: an initial pose estimation step, followed by a refinement procedure to correctly register the object and its observation. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Stefan Stevsic , Otmar Hilliges

Recently, neural radiance fields (NeRF) have gained significant attention in the field of visual localization. However, existing NeRF-based approaches either lack geometric constraints or require extensive storage for feature matching,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hongjia Zhai , Boming Zhao , Hai Li , Xiaokun Pan , Yijia He , Zhaopeng Cui , Hujun Bao , Guofeng Zhang

With the widespread use of NeRF-based implicit 3D representation, the need for camera localization in the same representation becomes manifestly apparent. Doing so not only simplifies the localization process -- by avoiding an…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Rashik Shrestha , Bishad Koju , Abhigyan Bhusal , Danda Pani Paudel , François Rameau

We present NeRF-Det, a novel method for indoor 3D detection with posed RGB images as input. Unlike existing indoor 3D detection methods that struggle to model scene geometry, our method makes novel use of NeRF in an end-to-end manner to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Chenfeng Xu , Bichen Wu , Ji Hou , Sam Tsai , Ruilong Li , Jialiang Wang , Wei Zhan , Zijian He , Peter Vajda , Kurt Keutzer , Masayoshi Tomizuka

This paper presents a NeRF-based framework for point cloud (PCD) reconstruction, specifically designed for indoor high-throughput plant phenotyping facilities. Traditional NeRF-based reconstruction methods require cameras to move around…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kibon Ku , Talukder Z Jubery , Elijah Rodriguez , Aditya Balu , Soumik Sarkar , Adarsh Krishnamurthy , Baskar Ganapathysubramanian

NeRFmm is the Neural Radiance Fields (NeRF) that deal with Joint Optimization tasks, i.e., reconstructing real-world scenes and registering camera parameters simultaneously. Despite NeRFmm producing precise scene synthesis and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yitong Xia , Hao Tang , Radu Timofte , Luc Van Gool

Object recognition and 6DoF pose estimation are quite challenging tasks in computer vision applications. Despite efficiency in such tasks, standard methods deliver far from real-time processing rates. This paper presents a novel pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Marlon Marcon , Olga Regina Pereira Bellon , Luciano Silva

Finding localized correspondences across different images of the same object is crucial to understand its geometry. In recent years, this problem has seen remarkable progress with the advent of deep learning-based local image features and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Arjun Karpur , Guilherme Perrotta , Ricardo Martin-Brualla , Howard Zhou , André Araujo

We propose MomentsNeRF, a novel framework for one- and few-shot neural rendering that predicts a neural representation of a 3D scene using Orthogonal Moments. Our architecture offers a new transfer learning method to train on multi-scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Ahmad AlMughrabi , Ricardo Marques , Petia Radeva

Monocular 3D reconstruction for categorical objects heavily relies on accurately perceiving each object's pose. While gradient-based optimization in a NeRF framework updates the initial pose, this paper highlights that scale-depth ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yuliang Guo , Abhinav Kumar , Cheng Zhao , Ruoyu Wang , Xinyu Huang , Liu Ren

Human pose capture is essential for sports analysis, enabling precise evaluation of athletes' movements. While deep learning-based human pose estimation (HPE) models from RGB videos have achieved impressive performance on public datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Qi Gan , Sao Mai Nguyen , Eric Fenaux , Stephan Clémençon , Mounîm El Yacoubi

Recent advances in neural rendering have enabled highly photorealistic 3D scene reconstruction and novel view synthesis. Despite this progress, current state-of-the-art methods struggle to reconstruct high frequency detail, due to factors…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sibi Catley-Chandar , Richard Shaw , Gregory Slabaugh , Eduardo Perez-Pellitero