English

The Sampling-Gaussian for stereo matching

Computer Vision and Pattern Recognition 2024-10-10 v1 Artificial Intelligence

Abstract

The soft-argmax operation is widely adopted in neural network-based stereo matching methods to enable differentiable regression of disparity. However, network trained with soft-argmax is prone to being multimodal due to absence of explicit constraint to the shape of the probability distribution. Previous methods leverages Laplacian distribution and cross-entropy for training but failed to effectively improve the accuracy and even compromises the efficiency of the network. In this paper, we conduct a detailed analysis of the previous distribution-based methods and propose a novel supervision method for stereo matching, Sampling-Gaussian. We sample from the Gaussian distribution for supervision. Moreover, we interpret the training as minimizing the distance in vector space and propose a combined loss of L1 loss and cosine similarity loss. Additionally, we leveraged bilinear interpolation to upsample the cost volume. Our method can be directly applied to any soft-argmax-based stereo matching method without a reduction in efficiency. We have conducted comprehensive experiments to demonstrate the superior performance of our Sampling-Gaussian. The experimental results prove that we have achieved better accuracy on five baseline methods and two datasets. Our method is easy to implement, and the code is available online.

Keywords

Cite

@article{arxiv.2410.06527,
  title  = {The Sampling-Gaussian for stereo matching},
  author = {Baiyu Pan and jichao jiao and Bowen Yao and Jianxin Pang and Jun Cheng},
  journal= {arXiv preprint arXiv:2410.06527},
  year   = {2024}
}

Comments

TL;DR: A novel Gaussian distribution-based supervision method for stereo matching. Implemented with five baseline methods and achieves notable improvement. Main content, 10 pages. conference submission

R2 v1 2026-06-28T19:13:47.076Z