English
Related papers

Related papers: Deep Stereo Matching with Explicit Cost Aggregatio…

200 papers

To reduce the human efforts in neural network design, Neural Architecture Search (NAS) has been applied with remarkable success to various high-level vision tasks such as classification and semantic segmentation. The underlying idea for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Xuelian Cheng , Yiran Zhong , Mehrtash Harandi , Yuchao Dai , Xiaojun Chang , Tom Drummond , Hongdong Li , Zongyuan Ge

Stereo is a prominent technique to infer dense depth maps from images, and deep learning further pushed forward the state-of-the-art, making end-to-end architectures unrivaled when enough data is available for training. However, deep…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Matteo Poggi , Davide Pallotti , Fabio Tosi , Stefano Mattoccia

Volumetric deep learning approach towards stereo matching aggregates a cost volume computed from input left and right images using 3D convolutions. Recent works showed that utilization of extracted image features and a spatially varying…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Antyanta Bangunharcana , Jae Won Cho , Seokju Lee , In So Kweon , Kyung-Soo Kim , Soohyun Kim

We introduce Double Cost Volume Stereo Matching Network(DCVSMNet) which is a novel architecture characterised by by two small upper (group-wise) and lower (norm correlation) cost volumes. Each cost volume is processed separately, and a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Mahmoud Tahmasebi , Saif Huq , Kevin Meehan , Marion McAfee

We introduce Stereo Risk, a new deep-learning approach to solve the classical stereo-matching problem in computer vision. As it is well-known that stereo matching boils down to a per-pixel disparity estimation problem, the popular…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Ce Liu , Suryansh Kumar , Shuhang Gu , Radu Timofte , Yao Yao , Luc Van Gool

A robust solution for semi-dense stereo matching is presented. It utilizes two CNN models for computing stereo matching cost and performing confidence-based filtering, respectively. Compared to existing CNNs-based matching cost generation…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Wendong Mao , Mingjie Wang , Jun Zhou , Minglun Gong

Although deep learning-based methods have dominated stereo matching leaderboards by yielding unprecedented disparity accuracy, their inference time is typically slow, on the order of seconds for a pair of 540p images. The main reason is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yiran Zhong , Charles Loop , Wonmin Byeon , Stan Birchfield , Yuchao Dai , Kaihao Zhang , Alexey Kamenev , Thomas Breuel , Hongdong Li , Jan Kautz

We propose a novel deep learning architecture for regressing disparity from a rectified pair of stereo images. We leverage knowledge of the problem's geometry to form a cost volume using deep feature representations. We learn to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Alex Kendall , Hayk Martirosyan , Saumitro Dasgupta , Peter Henry , Ryan Kennedy , Abraham Bachrach , Adam Bry

Motivated by the need to identify erroneous disparity assignments, various approaches for uncertainty and confidence estimation of dense stereo matching have been presented in recent years. As in many other fields, especially deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Max Mehltretter

Multi-view stereo is an important research task in computer vision while still keeping challenging. In recent years, deep learning-based methods have shown superior performance on this task. Cost volume pyramid network-based methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Shiyu Gao , Zhaoxin Li , Zhaoqi Wang

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon

Convolutional neural network (CNN)-based stereo matching approaches generally require a dense cost volume (DCV) for disparity estimation. However, generating such cost volumes is computationally-intensive and memory-consuming, hindering CNN…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Hengli Wang , Rui Fan , Ming Liu

Deep learning (DL) stereo matching methods gained great attention in remote sensing satellite datasets. However, most of these existing studies conclude assessments based only on a few/single stereo images lacking a systematic evaluation on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Hessah Albanwan , Rongjun Qin

Previous monocular depth estimation methods take a single view and directly regress the expected results. Though recent advances are made by applying geometrically inspired loss functions during training, the inference procedure does not…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Yue Luo , Jimmy Ren , Mude Lin , Jiahao Pang , Wenxiu Sun , Hongsheng Li , Liang Lin

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

Being a crucial task of autonomous driving, Stereo matching has made great progress in recent years. Existing stereo matching methods estimate disparity instead of depth. They treat the disparity errors as the evaluation metric of the depth…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Hong Zhang , Haojie Li , Shenglun Chen , Tiantian Yan , Zhihui Wang , Guo Lu , Wanli Ouyang

Our goal is to significantly speed up the runtime of current state-of-the-art stereo algorithms to enable real-time inference. Towards this goal, we developed a differentiable PatchMatch module that allows us to discard most disparities…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Shivam Duggal , Shenlong Wang , Wei-Chiu Ma , Rui Hu , Raquel Urtasun

We propose a system that uses a convolution neural network (CNN) to estimate depth from a stereo pair followed by volumetric fusion of the predicted depth maps to produce a 3D reconstruction of a scene. Our proposed depth refinement…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Rohan Chabra , Julian Straub , Chris Sweeney , Richard Newcombe , Henry Fuchs

This study addresses the application of deep learning techniques in joint sound signal classification and localization networks. Current state-of-the-art sound source localization deep learning networks lack feature aggregation within their…

Sound · Computer Science 2024-01-30 Brendan Healy , Patrick McNamee , Zahra Nili Ahmadabadi

Stereo matching is one of the most popular techniques to estimate dense depth maps by finding the disparity between matching pixels on two, synchronized and rectified images. Alongside with the development of more accurate algorithms, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Matteo Poggi , Seungryong Kim , Fabio Tosi , Sunok Kim , Filippo Aleotti , Dongbo Min , Kwanghoon Sohn , Stefano Mattoccia