English
Related papers

Related papers: Multi-Scale Cost Volumes Cascade Network for Stere…

200 papers

Stereo matching plays an indispensable part in autonomous driving, robotics and 3D scene reconstruction. We propose a novel deep learning architecture, which called CFP-Net, a Cross-Form Pyramid stereo matching network for regressing…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Zhidong Zhu , Mingyi He , Yuchao Dai , Zhibo Rao , Bo Li

Due to its capability to identify erroneous disparity assignments in dense stereo matching, confidence estimation is beneficial for a wide range of applications, e.g. autonomous driving, which needs a high degree of confidence as mandatory…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Max Mehltretter , Christian Heipke

Leveraging on the recent developments in convolutional neural networks (CNNs), matching dense correspondence from a stereo pair has been cast as a learning problem, with performance exceeding traditional approaches. However, it remains…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Jiahao Pang , Wenxiu Sun , Jimmy SJ. Ren , Chengxi Yang , Qiong Yan

We present Uncertainty-aware Cascaded Stereo Network (UCS-Net) for 3D reconstruction from multiple RGB images. Multi-view stereo (MVS) aims to reconstruct fine-grained scene geometry from multi-view images. Previous learning-based MVS…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Shuo Cheng , Zexiang Xu , Shilin Zhu , Zhuwen Li , Li Erran Li , Ravi Ramamoorthi , Hao Su

We propose a system that uses a convolution neural network (CNN) to estimate depth from a stereo pair followed by volumetric fusion of the predicted depth maps to produce a 3D reconstruction of a scene. Our proposed depth refinement…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Rohan Chabra , Julian Straub , Chris Sweeney , Richard Newcombe , Henry Fuchs

We propose a cost volume-based neural network for depth inference from multi-view images. We demonstrate that building a cost volume pyramid in a coarse-to-fine manner instead of constructing a cost volume at a fixed resolution leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jiayu Yang , Wei Mao , Jose M. Alvarez , Miaomiao Liu

We present a new deep learning-based approach for dense stereo matching. Compared to previous works, our approach does not use deep learning of pixel appearance descriptors, employing very fast classical matching scores instead. At the same…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Andrey Kuzmin , Dmitry Mikushin , Victor Lempitsky

Multi-view stereo (MVS) is a crucial task for precise 3D reconstruction. Most recent studies tried to improve the performance of matching cost volume in MVS by designing aggregated 3D cost volumes and their regularization. This paper…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Khang Truong Giang , Soohwan Song , Sungho Jo

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

Recent methods in stereo matching have continuously improved the accuracy using deep models. This gain, however, is attained with a high increase in computation cost, such that the network may not fit even on a moderate GPU. This issue…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Faranak Shamsafar , Samuel Woerz , Rafia Rahim , Andreas Zell

Learning-based multi-view stereo (MVS) methods have demonstrated promising results. However, very few existing networks explicitly take the pixel-wise visibility into consideration, resulting in erroneous cost aggregation from occluded…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jingyang Zhang , Yao Yao , Shiwei Li , Zixin Luo , Tian Fang

Despite the remarkable progress made by learning based stereo matching algorithms, one key challenge remains unsolved. Current state-of-the-art stereo models are mostly based on costly 3D convolutions, the cubic computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Haofei Xu , Juyong Zhang

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan

This paper presents a stereo object matching method that exploits both 2D contextual information from images as well as 3D object-level information. Unlike existing stereo matching methods that exclusively focus on the pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jaesung Choe , Kyungdon Joo , Francois Rameau , In So Kweon

Existing stereo matching networks typically rely on either cost-volume construction based on 3D convolutions or deformation methods based on iterative optimization. The former incurs significant computational overhead during cost…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Ao Xu , Rujin Zhao , Xiong Xu , Boceng Huang , Yujia Jia , Hongfeng Long , Fuxuan Chen , Zilong Cao , Fangyuan Chen

Multi-view Stereo (MVS) aims to estimate depth and reconstruct 3D point clouds from a series of overlapping images. Recent learning-based MVS frameworks overlook the geometric information embedded in features and correlations, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuxi Hu , Jun Zhang , Zhe Zhang , Rafael Weilharter , Yuchen Rao , Kuangyi Chen , Runze Yuan , Friedrich Fraundorfer

Current state-of-the-art flow methods are mostly based on dense all-pairs cost volumes. However, as image resolution increases, the computational and spatial complexity of constructing these cost volumes grows at a quartic rate, making…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yang Zhao , Gangwei Xu , Gang Wu

We present a method for extracting depth information from a rectified image pair. Our approach focuses on the first stage of many stereo algorithms: the matching cost computation. We approach the problem by learning a similarity measure on…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Jure Žbontar , Yann LeCun

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon