English
Related papers

Related papers: Do End-to-end Stereo Algorithms Under-utilize Info…

200 papers

Despite the great success of deep learning in stereo matching, recovering accurate disparity maps is still challenging. Currently, L1 and cross-entropy are the two most widely used losses for stereo network training. Compared with the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Peng Xu , Zhiyu Xiang , Chenyu Qiao , Jingyun Fu , Tianyu Pu

Compared with cheap addition operation, multiplication operation is of much higher computation complexity. The widely-used convolutions in deep neural networks are exactly cross-correlation to measure the similarity between input feature…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hanting Chen , Yunhe Wang , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

In this paper, we present a novel end-to-end network architecture to estimate fundamental matrix directly from stereo images. To establish a complete working pipeline, different deep neural networks in charge of finding correspondences in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yesheng Zhang , Xu Zhao , Dahong Qian

End-to-end deep learning methods have advanced stereo vision in recent years and obtained excellent results when the training and test data are similar. However, large datasets of diverse real-world scenes with dense ground truth are…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Jialiang Wang , Varun Jampani , Deqing Sun , Charles Loop , Stan Birchfield , Jan Kautz

Motivated by the need to identify erroneous disparity assignments, various approaches for uncertainty and confidence estimation of dense stereo matching have been presented in recent years. As in many other fields, especially deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Max Mehltretter

In this paper, we present Shift Convolution Network (ShiftConvNet) to provide matching capability between two feature maps for stereo estimation. The proposed method can speedily produce a highly accurate disparity map from stereo images. A…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Jian Xie

This paper presents HITNet, a novel neural network architecture for real-time stereo matching. Contrary to many recent neural network approaches that operate on a full cost volume and rely on 3D convolutions, our approach does not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Vladimir Tankovich , Christian Häne , Yinda Zhang , Adarsh Kowdle , Sean Fanello , Sofien Bouaziz

Efficient yet accurate extraction of depth from stereo image pairs is required by systems with low power resources, such as robotics and embedded systems. State-of-the-art stereo matching methods based on convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Rafael Brandt , Nicola Strisciuglio , Nicolai Petkov

Despite the remarkable progress of deep learning in stereo matching, there exists a gap in accuracy between real-time models and slower state-of-the-art models which are suitable for practical applications. This paper presents an iterative…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Kumail Raza , René Schuster , Didier Stricker

Stereo matching estimates the disparity between a rectified image pair, which is of great importance to depth sensing, autonomous driving, and other related tasks. Previous works built cost volumes with cross-correlation or concatenation of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Xiaoyang Guo , Kai Yang , Wukui Yang , Xiaogang Wang , Hongsheng Li

Computational stereo has reached a high level of accuracy, but degrades in the presence of occlusions, repeated textures, and correspondence errors along edges. We present a novel approach based on neural networks for depth estimation that…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yinda Zhang , Neal Wadhwa , Sergio Orts-Escolano , Christian Häne , Sean Fanello , Rahul Garg

Stereo reconstruction from rectified images has recently been revisited within the context of deep learning. Using a deep Convolutional Neural Network to obtain patch-wise matching cost volumes has resulted in state of the art stereo…

Computer Vision and Pattern Recognition · Computer Science 2017-01-26 Ron Slossberg , Aaron Wetzler , Ron Kimmel

Large-scale synthetic datasets are beneficial to stereo matching but usually introduce known domain bias. Although unsupervised image-to-image translation networks represented by CycleGAN show great potential in dealing with domain gap, it…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Rui Liu , Chengxi Yang , Wenxiu Sun , Xiaogang Wang , Hongsheng Li

Deep neural networks are applied to a wide range of problems in recent years. In this work, Convolutional Neural Network (CNN) is applied to the problem of determining the depth from a single camera image (monocular depth). Eight different…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 S. Bazrafkan , H. Javidnia , J. Lemley , P. Corcoran

This work presents dense stereo reconstruction using high-resolution images for infrastructure inspections. The state-of-the-art stereo reconstruction methods, both learning and non-learning ones, consume too much computational resource on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yaoyu Hu , Weikun Zhen , Sebastian Scherer

This paper presents StereoNet, the first end-to-end deep architecture for real-time stereo matching that runs at 60 fps on an NVidia Titan X, producing high-quality, edge-preserved, quantization-free disparity maps. A key insight of this…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Sameh Khamis , Sean Fanello , Christoph Rhemann , Adarsh Kowdle , Julien Valentin , Shahram Izadi

Unsupervised cross-spectral stereo matching aims at recovering disparity given cross-spectral image pairs without any supervision in the form of ground truth disparity or depth. The estimated depth provides additional information…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Mingyang Liang , Xiaoyang Guo , Hongsheng Li , Xiaogang Wang , You Song

Our goal is to significantly speed up the runtime of current state-of-the-art stereo algorithms to enable real-time inference. Towards this goal, we developed a differentiable PatchMatch module that allows us to discard most disparities…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Shivam Duggal , Shenlong Wang , Wei-Chiu Ma , Rui Hu , Raquel Urtasun

Volumetric deep learning approach towards stereo matching aggregates a cost volume computed from input left and right images using 3D convolutions. Recent works showed that utilization of extracted image features and a spatially varying…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Antyanta Bangunharcana , Jae Won Cho , Seokju Lee , In So Kweon , Kyung-Soo Kim , Soohyun Kim

Deep stereo matching has made significant progress in recent years. However, state-of-the-art methods are based on expensive 4D cost volume, which limits their use in real-world applications. To address this issue, 3D correlation maps and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Xiaoming Zhao , Weihai Chen , Xingming Wu , Peter C. Y. Chen , Zhengguo Li