English
Related papers

Related papers: Self-supervised 6D Object Pose Estimation for Robo…

200 papers

Deep object pose estimators are notoriously overconfident. A grasping agent that both estimates the 6-DoF pose of a target object and predicts the uncertainty of its own estimate could avoid task failure by choosing not to act under high…

Robotics · Computer Science 2025-06-27 Eric C. Joyce , Qianwen Zhao , Nathaniel Burgdorfer , Long Wang , Philippos Mordohai

Progress in self-supervised learning has brought strong general image representation learning methods. Yet so far, it has mostly focused on image-level learning. In turn, tasks such as unsupervised image segmentation have not benefited from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Adrian Ziegler , Yuki M. Asano

Manipulation of deformable objects, such as ropes and cloth, is an important but challenging problem in robotics. We present a learning-based system where a robot takes as input a sequence of images of a human manipulating a rope from an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Ashvin Nair , Dian Chen , Pulkit Agrawal , Phillip Isola , Pieter Abbeel , Jitendra Malik , Sergey Levine

6D object pose estimation aims to infer the relative pose between the object and the camera using a single image or multiple images. Most works have focused on predicting the object pose without associated uncertainty under occlusion and…

Robotics · Computer Science 2022-11-03 Myung-Hwan Jeon , Jeongyun Kim , Jee-Hwan Ryu , Ayoung Kim

This article illustrates the application of deep learning to robot touch by considering a basic yet fundamental capability: estimating the relative pose of part of an object in contact with a tactile sensor. We begin by surveying deep…

Robotics · Computer Science 2020-03-31 Nathan F. Lepora , John Lloyd

Robots are expected to replace menial tasks such as housework. Some of these tasks include nonprehensile manipulation performed without grasping objects. Nonprehensile manipulation is very difficult because it requires considering the…

Robotics · Computer Science 2022-06-23 Yuki Saigusa , Sho Sakaino , Toshiaki Tsuji

Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant. However, as the acquisition of ground-truth 3D labels is labor intensive and time consuming, recent attention has shifted…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soumava Kumar Roy , Leonardo Citraro , Sina Honari , Pascal Fua

Object pose estimation enables a variety of tasks in computer vision and robotics, including scene understanding and robotic grasping. The complexity of a pose estimation task depends on the unknown variables related to the target object.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Peter Hönig , Matthias Hirschmanner , Markus Vincze

The most recent trend in estimating the 6D pose of rigid objects has been to train deep networks to either directly regress the pose from the image or to predict the 2D locations of 3D keypoints, from which the pose can be obtained using a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yinlin Hu , Joachim Hugonot , Pascal Fua , Mathieu Salzmann

Human pose estimation from single images is a challenging problem that is typically solved by supervised learning. Unfortunately, labeled training data does not yet exist for many human activities since 3D annotation requires dedicated…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Bastian Wandt , James J. Little , Helge Rhodin

This paper describes recent developments in object specific pose and shape prediction from single images. The main contribution is a new approach to camera pose prediction by self-supervised learning of keypoints corresponding to locations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Zahra Gharaee , Felix Järemo Lawin , Per-Erik Forssén

This paper presents a comprehensive survey on vision-based robotic grasping. We conclude three key tasks during vision-based robotic grasping, which are object localization, object pose estimation and grasp estimation. In detail, the object…

Robotics · Computer Science 2020-12-24 Guoguang Du , Kai Wang , Shiguo Lian , Kaiyong Zhao

6D object pose estimation is widely applied in robotic tasks such as grasping and manipulation. Prior methods using RGB-only images are vulnerable to heavy occlusion and poor illumination, so it is important to complement them with depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Yi Cheng , Hongyuan Zhu , Ying Sun , Cihan Acar , Wei Jing , Yan Wu , Liyuan Li , Cheston Tan , Joo-Hwee Lim

Object pose estimation is important for object manipulation and scene understanding. In order to improve the general applicability of pose estimators, recent research focuses on providing estimates for novel objects, that is objects unseen…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Stefan Thalhammer , Jean-Baptiste Weibel , Markus Vincze , Jose Garcia-Rodriguez

We propose a self-supervised approach for learning representations of objects from monocular videos and demonstrate it is particularly useful in situated settings such as robotics. The main contributions of this paper are: 1) a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Sören Pirk , Mohi Khansari , Yunfei Bai , Corey Lynch , Pierre Sermanet

Object pose estimation underwater allows an autonomous system to perform tracking and intervention tasks. Nonetheless, underwater target pose estimation is remarkably challenging due to, among many factors, limited visibility, light…

Category-level object pose estimation aims to find 6D object poses of previously unseen object instances from known categories without access to object CAD models. To reduce the huge amount of pose annotations needed for category-level…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Xiaolong Li , Yijia Weng , Li Yi , Leonidas Guibas , A. Lynn Abbott , Shuran Song , He Wang

For many practical problems and applications, it is not feasible to create a vast and accurately labeled dataset, which restricts the application of deep learning in many areas. Semi-supervised learning algorithms intend to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Mert Kayhan , Okan Köpüklü , Mhd Hasan Sarhan , Mehmet Yigitsoy , Abouzar Eslami , Gerhard Rigoll

In object-based Simultaneous Localization and Mapping (SLAM), 6D object poses offer a compact representation of landmark geometry useful for downstream planning and manipulation tasks. However, measurement ambiguity then arises as objects…

Robotics · Computer Science 2021-08-04 Jiahui Fu , Qiangqiang Huang , Kevin Doherty , Yue Wang , John J. Leonard

While much progress has been made on the task of 3D point cloud registration, there still exists no learning-based method able to estimate the 6D pose of an object observed by a 2.5D sensor in a scene. The challenges of this scenario…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zheng Dang , Fei Wang , Mathieu Salzmann