English

SSLayout360: Semi-Supervised Indoor Layout Estimation from 360-Degree Panorama

Computer Vision and Pattern Recognition 2021-05-18 v3 Machine Learning

Abstract

Recent years have seen flourishing research on both semi-supervised learning and 3D room layout reconstruction. In this work, we explore the intersection of these two fields to advance the research objective of enabling more accurate 3D indoor scene modeling with less labeled data. We propose the first approach to learn representations of room corners and boundaries by using a combination of labeled and unlabeled data for improved layout estimation in a 360-degree panoramic scene. Through extensive comparative experiments, we demonstrate that our approach can advance layout estimation of complex indoor scenes using as few as 20 labeled examples. When coupled with a layout predictor pre-trained on synthetic data, our semi-supervised method matches the fully supervised counterpart using only 12% of the labels. Our work takes an important first step towards robust semi-supervised layout estimation that can enable many applications in 3D perception with limited labeled data.

Keywords

Cite

@article{arxiv.2103.13696,
  title  = {SSLayout360: Semi-Supervised Indoor Layout Estimation from 360-Degree Panorama},
  author = {Phi Vu Tran},
  journal= {arXiv preprint arXiv:2103.13696},
  year   = {2021}
}

Comments

CVPR 2021. File size 37MB. Project page at https://github.com/FlyreelAI/sslayout360

R2 v1 2026-06-24T00:32:46.243Z