English
Related papers

Related papers: NeRF-Feat: 6D Object Pose Estimation using Feature…

200 papers

In the task of Object Recognition, there exists a dichotomy between the categorization of objects and estimating object pose, where the former necessitates a view-invariant representation, while the latter requires a representation capable…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Mohamed Elhoseiny , Tarek El-Gaaly , Amr Bakry , Ahmed Elgammal

Pose-free neural radiance fields (NeRF) aim to train NeRF with unposed multi-view images and it has achieved very impressive success in recent years. Most existing works share the pipeline of training a coarse pose estimator with rendered…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Jiahui Zhang , Fangneng Zhan , Yingchen Yu , Kunhao Liu , Rongliang Wu , Xiaoqin Zhang , Ling Shao , Shijian Lu

Deep Convolutional Neural Networks (CNNs) have been successfully deployed on robots for 6-DoF object pose estimation through visual perception. However, obtaining labeled data on a scale required for the supervised training of CNNs is a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Rohan Pratap Singh , Mehdi Benallegue , Yusuke Yoshiyasu , Fumio Kanehiro

Spacecraft pose estimation networks require tens of thousands of CAD-rendered images to be trained. This reliance on synthetic CAD data (i) limits applicability to targets with reliable geometry prior, excluding uncooperative or poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Antoine Legrand , Renaud Detry , Christophe De Vleeschouwer

Robotic systems often require precise scene analysis capabilities, especially in unstructured, cluttered situations, as occurring in human-made environments. While current deep-learning based methods yield good estimates of object poses,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-09 Arul Selvam Periyasamy , Max Schwarz , Sven Behnke

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

This paper tackles the simultaneous optimization of pose and Neural Radiance Fields (NeRF). Departing from the conventional practice of using explicit global representations for camera pose, we propose a novel overparameterized…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Shin-Fang Chng , Ravi Garg , Hemanth Saratchandran , Simon Lucey

The task of 6D object pose estimation from RGB images is an important requirement for autonomous service robots to be able to interact with the real world. In this work, we present a two-step pipeline for estimating the 6 DoF translation…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Moritz Zappel , Simon Bultmann , Sven Behnke

Although 3D-aware GANs based on neural radiance fields have achieved competitive performance, their applicability is still limited to objects or scenes with the ground-truths or prediction models for clearly defined canonical camera poses.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Mijeong Kim , Hyunjoon Lee , Bohyung Han

We consider the problem of category-level 6D pose estimation from a single RGB image. Our approach represents an object category as a cuboid mesh and learns a generative model of the neural feature activations at each mesh vertex to perform…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Wufei Ma , Angtian Wang , Alan Yuille , Adam Kortylewski

In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Qunjie Zhou , Maxim Maximov , Or Litany , Laura Leal-Taixé

We study the problem of learning to estimate the 3D object pose from a few labelled examples and a collection of unlabelled data. Our main contribution is a learning framework, neural view synthesis and matching, that can transfer the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Angtian Wang , Shenxiao Mei , Alan Yuille , Adam Kortylewski

Recent methods for 6D pose estimation of objects assume either textured 3D models or real images that cover the entire range of target poses. However, it is difficult to obtain textured 3D models and annotate the poses of objects in real…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Kiru Park , Timothy Patten , Markus Vincze

Neural implicit representations such as NeRF have revolutionized 3D scene representation with photo-realistic quality. However, existing methods for visual localization within NeRF representations suffer from inefficiency and scalability…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Huaiji Zhou , Bing Wang , Changhao Chen

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed traditional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Ali Youssef , Francisco Vasconcelos

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

The problem of inferring object shape from a single 2D image is underconstrained. Prior knowledge about what objects are plausible can help, but even given such prior knowledge there may still be uncertainty about the shapes of occluded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Matthew D. Hoffman , Tuan Anh Le , Pavel Sountsov , Christopher Suter , Ben Lee , Vikash K. Mansinghka , Rif A. Saurous

We propose CLA-NeRF -- a Category-Level Articulated Neural Radiance Field that can perform view synthesis, part segmentation, and articulated pose estimation. CLA-NeRF is trained at the object category level using no CAD models and no…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Wei-Cheng Tseng , Hung-Ju Liao , Lin Yen-Chen , Min Sun

On-orbit operations require the estimation of the relative 6D pose, i.e., position and orientation, between a chaser spacecraft and its target. While data-driven spacecraft pose estimation methods have been developed, their adoption in real…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Antoine Legrand , Renaud Detry , Christophe De Vleeschouwer

This work proposes a process for efficiently training a point-wise object detector that enables localizing objects and computing their 6D poses in cluttered and occluded scenes. Accurate pose estimation is typically a requirement for robust…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Jean-Philippe Mercier , Chaitanya Mitash , Philippe Giguère , Abdeslam Boularias