English
Related papers

Related papers: Fit-NGP: Fitting Object Models to Neural Graphics …

200 papers

We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene. Given a single observed RGB image of the target, we can predict the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yunzhi Lin , Thomas Müller , Jonathan Tremblay , Bowen Wen , Stephen Tyree , Alex Evans , Patricio A. Vela , Stan Birchfield

6D object pose estimation remains challenging for many applications due to dependencies on complete 3D models, multi-view images, or training limited to specific object categories. These requirements make generalization to novel objects…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Mengya Liu , Siyuan Li , Ajad Chhatkuli , Prune Truong , Luc Van Gool , Federico Tombari

Pose estimation is a vital step in many robotics and perception tasks such as robotic manipulation, autonomous vehicle navigation, etc. Current state-of-the-art pose estimation methods rely on deep neural networks with complicated…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Abhinav Jain , Frank Dellaert

We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori, and then adapt it to the task of category-independent…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Qihao Liu , Weichao Qiu , Weiyao Wang , Gregory D. Hager , Alan L. Yuille

We present a novel approach to the detection and 3D pose estimation of objects in color images. Its main contribution is that it does not require any training phases nor data for new objects, while state-of-the-art methods typically require…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Giorgia Pitteri , Slobodan Ilic , Vincent Lepetit

We propose a method for 6DoF pose estimation of rigid objects that uses a state-of-the-art deep learning based instance detector to segment object instances in an RGB image, followed by a point-pair based voting method to recover the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Rebecca König , Bertram Drost

Many object pose estimation algorithms rely on the analysis-by-synthesis framework which requires explicit representations of individual object instances. In this paper we combine a gradient-based fitting procedure with a parametric neural…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Xu Chen , Zijian Dong , Jie Song , Andreas Geiger , Otmar Hilliges

Radiance fields including NeRFs and 3D Gaussians demonstrate great potential in high-fidelity rendering and scene reconstruction, while they require a substantial number of posed images as inputs. COLMAP is frequently employed for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Zhirui Gao , Renjiao Yi , Chenyang Zhu , Ke Zhuang , Wei Chen , Kai Xu

The process of tracking human anatomy in computer vision is referred to pose estimation, and it is used in fields ranging from gaming to surveillance. Three-dimensional pose estimation traditionally requires advanced equipment, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Alice Ruget , Max Tyler , Germán Mora Martín , Stirling Scholes , Feng Zhu , Istvan Gyongy , Brent Hearn , Steve McLaughlin , Abderrahim Halimi , Jonathan Leach

State estimation from measured data is crucial for robotic applications as autonomous systems rely on sensors to capture the motion and localize in the 3D world. Among sensors that are designed for measuring a robot's pose, or for soft…

Robotics · Computer Science 2023-02-28 Jingpei Lu , Fei Liu , Cedric Girerd , Michael C. Yip

The task of 6DoF object pose estimation is one of the fundamental problems of 3D vision with many practical applications such as industrial automation. Traditional deep learning approaches for this task often require extensive training data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Matej Mok , Lukáš Gajdošech , Michal Mesároš , Martin Madaras , Viktor Kocur

Vision based object grasping and manipulation in robotics require accurate estimation of object's 6D pose. The 6D pose estimation has received significant attention in computer vision community and multiple datasets and evaluation metrics…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Antti Hietanen , Jyrki Latokartano , Alessandro Foi , Roel Pieters , Ville Kyrki , Minna Lanz , Joni-Kristian Kämäräinen

State-of-the-art object pose estimation handles multiple instances in a test image by using multi-model formulations: detection as a first stage and then separately trained networks per object for 2D-3D geometric correspondence prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Stefan Thalhammer , Timothy Patten , Markus Vincze

This paper introduces key machine learning operations that allow the realization of robust, joint 6D pose estimation of multiple instances of objects either densely packed or in unstructured piles from RGB-D data. The first objective is to…

Robotics · Computer Science 2019-10-14 Chaitanya Mitash , Bowen Wen , Kostas Bekris , Abdeslam Boularias

Given the image collection of an object, we aim at building a real-time image-based pose estimation method, which requires neither its CAD model nor hours of object-specific training. Recent NeRF-based methods provide a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ronghan Chen , Yang Cong , Yu Ren

Neural fields provide a continuous scene representation of 3D geometry and appearance in a way which has great promise for robotics applications. One functionality that unlocks unique use-cases for neural fields in robotics is object 6-DoF…

Robotics · Computer Science 2024-05-06 David Hall , Stephen Hausler , Sutharsan Mahendren , Peyman Moghadam

Obtaining a better knowledge of the current state and behavior of objects orbiting Earth has proven to be essential for a range of applications such as active debris removal, in-orbit maintenance, or anomaly detection. 3D models represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Clément Forray , Pauline Delporte , Nicolas Delaygue , Florence Genin , Dawa Derksen

In this paper, we proposed a pose estimation system based on rendered image training set, which predicts the pose of objects in real image, with knowledge of object category and tight bounding box. We developed a patch-based multi-class…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Chuiwen Ma , Hao Su , Liang Shi

One core challenge in object pose estimation is to ensure accurate and robust performance for large numbers of diverse foreground objects amidst complex background clutter. In this work, we present a scalable framework for accurately…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Chi Li , Jin Bai , Gregory D. Hager

In this paper, we propose an efficient end-to-end algorithm to tackle the problem of estimating the 6D pose of objects from a single RGB image. Our system trains a fully convolutional network to regress the 3D rotation and the 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Jin Liu , Sheng He