English

Stereo-Matching Knowledge Distilled Monocular Depth Estimation Filtered by Multiple Disparity Consistency

Computer Vision and Pattern Recognition 2024-01-24 v2

Abstract

In stereo-matching knowledge distillation methods of the self-supervised monocular depth estimation, the stereo-matching network's knowledge is distilled into a monocular depth network through pseudo-depth maps. In these methods, the learning-based stereo-confidence network is generally utilized to identify errors in the pseudo-depth maps to prevent transferring the errors. However, the learning-based stereo-confidence networks should be trained with ground truth (GT), which is not feasible in a self-supervised setting. In this paper, we propose a method to identify and filter errors in the pseudo-depth map using multiple disparity maps by checking their consistency without the need for GT and a training process. Experimental results show that the proposed method outperforms the previous methods and works well on various configurations by filtering out erroneous areas where the stereo-matching is vulnerable, especially such as textureless regions, occlusion boundaries, and reflective surfaces.

Keywords

Cite

@article{arxiv.2401.12019,
  title  = {Stereo-Matching Knowledge Distilled Monocular Depth Estimation Filtered by Multiple Disparity Consistency},
  author = {Woonghyun Ka and Jae Young Lee and Jaehyun Choi and Junmo Kim},
  journal= {arXiv preprint arXiv:2401.12019},
  year   = {2024}
}

Comments

ICASSP 2024. The first two authors are equally contributed

R2 v1 2026-06-28T14:23:37.146Z