中文

M^3VSNet:无监督多度量多视图立体网络

计算机视觉与模式识别 2020-06-09 v2

摘要

当前基于监督学习网络的多视图立体(MVS)方法相较于传统MVS方法具有令人印象深刻的性能。然而,用于训练的ground-truth深度图难以获取且局限于有限种类的场景。本文中,我们提出一种新颖的无监督多度量MVS网络,命名为M^3VSNet,用于在无任何监督下进行稠密点云重建。为提高点云重建的鲁棒性和完整性,我们提出一种新颖的多度量损失函数,其结合像素级和特征级损失函数,从不同匹配对应视角学习内在约束。此外,我们还在3D点云格式中引入法向-深度一致性,以提高估计深度图的准确性和连续性。实验结果表明,M3VSNet确立了最先进的(state-of-the-art)无监督方法,并在DTU数据集上取得与先前监督MVSNet相当的性能,且在Tanks and Temples基准上展现出强大的泛化能力并取得有效提升。我们的代码可在 https://github.com/whubaichuan/M3VSNet 获取。

关键词

引用

@article{arxiv.2005.00363,
  title  = {M^3VSNet: Unsupervised Multi-metric Multi-view Stereo Network},
  author = {Baichuan Huang and Hongwei Yi and Can Huang and Yijia He and Jingbin Liu and Xiao Liu},
  journal= {arXiv preprint arXiv:2005.00363},
  year   = {2020}
}

备注

The original top-level version is arXiv:2004.09722v2 but I upload the similar version to arXiv:2005.00363 mistakenly, which is overlapped with arXiv:2004.09722v2. So the submission is to make the two addresses keeping the same version