English

Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation

Computer Vision and Pattern Recognition 2017-04-10 v1

Abstract

This paper addresses the problem of depth estimation from a single still image. Inspired by recent works on multi- scale convolutional neural networks (CNN), we propose a deep model which fuses complementary information derived from multiple CNN side outputs. Different from previous methods, the integration is obtained by means of continuous Conditional Random Fields (CRFs). In particular, we propose two different variations, one based on a cascade of multiple CRFs, the other on a unified graphical model. By designing a novel CNN implementation of mean-field updates for continuous CRFs, we show that both proposed models can be regarded as sequential deep networks and that training can be performed end-to-end. Through extensive experimental evaluation we demonstrate the effective- ness of the proposed approach and establish new state of the art results on publicly available datasets.

Keywords

Cite

@article{arxiv.1704.02157,
  title  = {Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation},
  author = {Dan Xu and Elisa Ricci and Wanli Ouyang and Xiaogang Wang and Nicu Sebe},
  journal= {arXiv preprint arXiv:1704.02157},
  year   = {2017}
}

Comments

Accepted as a spotlight paper at CVPR 2017

R2 v1 2026-06-22T19:10:39.209Z