English

IEBins: Iterative Elastic Bins for Monocular Depth Estimation

Computer Vision and Pattern Recognition 2023-09-26 v1

Abstract

Monocular depth estimation (MDE) is a fundamental topic of geometric computer vision and a core technique for many downstream applications. Recently, several methods reframe the MDE as a classification-regression problem where a linear combination of probabilistic distribution and bin centers is used to predict depth. In this paper, we propose a novel concept of iterative elastic bins (IEBins) for the classification-regression-based MDE. The proposed IEBins aims to search for high-quality depth by progressively optimizing the search range, which involves multiple stages and each stage performs a finer-grained depth search in the target bin on top of its previous stage. To alleviate the possible error accumulation during the iterative process, we utilize a novel elastic target bin to replace the original target bin, the width of which is adjusted elastically based on the depth uncertainty. Furthermore, we develop a dedicated framework composed of a feature extractor and an iterative optimizer that has powerful temporal context modeling capabilities benefiting from the GRU-based architecture. Extensive experiments on the KITTI, NYU-Depth-v2 and SUN RGB-D datasets demonstrate that the proposed method surpasses prior state-of-the-art competitors. The source code is publicly available at https://github.com/ShuweiShao/IEBins.

Keywords

Cite

@article{arxiv.2309.14137,
  title  = {IEBins: Iterative Elastic Bins for Monocular Depth Estimation},
  author = {Shuwei Shao and Zhongcai Pei and Xingming Wu and Zhong Liu and Weihai Chen and Zhengguo Li},
  journal= {arXiv preprint arXiv:2309.14137},
  year   = {2023}
}

Comments

Accepted by NeurIPS 2023

R2 v1 2026-06-28T12:31:35.993Z