English

Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Image

Computer Vision and Pattern Recognition 2022-08-30 v2

Abstract

Recently, RGBD-based category-level 6D object pose estimation has achieved promising improvement in performance, however, the requirement of depth information prohibits broader applications. In order to relieve this problem, this paper proposes a novel approach named Object Level Depth reconstruction Network (OLD-Net) taking only RGB images as input for category-level 6D object pose estimation. We propose to directly predict object-level depth from a monocular RGB image by deforming the category-level shape prior into object-level depth and the canonical NOCS representation. Two novel modules named Normalized Global Position Hints (NGPH) and Shape-aware Decoupled Depth Reconstruction (SDDR) module are introduced to learn high fidelity object-level depth and delicate shape representations. At last, the 6D object pose is solved by aligning the predicted canonical representation with the back-projected object-level depth. Extensive experiments on the challenging CAMERA25 and REAL275 datasets indicate that our model, though simple, achieves state-of-the-art performance.

Keywords

Cite

@article{arxiv.2204.01586,
  title  = {Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Image},
  author = {Zhaoxin Fan and Zhenbo Song and Jian Xu and Zhicheng Wang and Kejian Wu and Hongyan Liu and Jun He},
  journal= {arXiv preprint arXiv:2204.01586},
  year   = {2022}
}

Comments

Accept to ECCV 2022

R2 v1 2026-06-24T10:37:11.488Z