English

Diffusion-Augmented Depth Prediction with Sparse Annotations

Computer Vision and Pattern Recognition 2023-08-07 v1

Abstract

Depth estimation aims to predict dense depth maps. In autonomous driving scenes, sparsity of annotations makes the task challenging. Supervised models produce concave objects due to insufficient structural information. They overfit to valid pixels and fail to restore spatial structures. Self-supervised methods are proposed for the problem. Their robustness is limited by pose estimation, leading to erroneous results in natural scenes. In this paper, we propose a supervised framework termed Diffusion-Augmented Depth Prediction (DADP). We leverage the structural characteristics of diffusion model to enforce depth structures of depth models in a plug-and-play manner. An object-guided integrality loss is also proposed to further enhance regional structure integrality by fetching objective information. We evaluate DADP on three driving benchmarks and achieve significant improvements in depth structures and robustness. Our work provides a new perspective on depth estimation with sparse annotations in autonomous driving scenes.

Keywords

Cite

@article{arxiv.2308.02283,
  title  = {Diffusion-Augmented Depth Prediction with Sparse Annotations},
  author = {Jiaqi Li and Yiran Wang and Zihao Huang and Jinghong Zheng and Ke Xian and Zhiguo Cao and Jianming Zhang},
  journal= {arXiv preprint arXiv:2308.02283},
  year   = {2023}
}

Comments

Accepted by ACM MM'2023

R2 v1 2026-06-28T11:48:04.437Z