English
Related papers

Related papers: How Good MVSNets Are at Depth Fusion

200 papers

Estimating depth from RGB images is a long-standing ill-posed problem, which has been explored for decades by the computer vision, graphics, and machine learning communities. Among the existing techniques, stereo matching remains one of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Hamid Laga , Laurent Valentin Jospin , Farid Boussaid , Mohammed Bennamoun

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan

We present an approach to depth estimation that fuses information from a stereo pair with sparse range measurements derived from a LIDAR sensor or a range camera. The goal of this work is to exploit the complementary strengths of the two…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Shreyas S. Shivakumar , Kartik Mohta , Bernd Pfrommer , Vijay Kumar , Camillo J. Taylor

Computational stereo has reached a high level of accuracy, but degrades in the presence of occlusions, repeated textures, and correspondence errors along edges. We present a novel approach based on neural networks for depth estimation that…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yinda Zhang , Neal Wadhwa , Sergio Orts-Escolano , Christian Häne , Sean Fanello , Rahul Garg

We study how autonomous robots can learn by themselves to improve their depth estimation capability. In particular, we investigate a self-supervised learning setup in which stereo vision depth estimates serve as targets for a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Diogo Martins , Kevin van Hecke , Guido de Croon

Disparity/depth estimation from sequences of stereo images is an important element in 3D vision. Owing to occlusions, imperfect settings and homogeneous luminance, accurate estimate of depth remains a challenging problem. Targetting view…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Nantheera Anantrasirichai , Majid Geravand , David Braendler , David R. Bull

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

Multi-view photometric stereo (MVPS) is a preferred method for detailed and precise 3D acquisition of an object from images. Although popular methods for MVPS can provide outstanding results, they are often complex to execute and limited to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

While deep learning has recently achieved great success on multi-view stereo (MVS), limited training data makes the trained model hard to be generalized to unseen scenarios. Compared with other computer vision tasks, it is rather difficult…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yao Yao , Zixin Luo , Shiwei Li , Jingyang Zhang , Yufan Ren , Lei Zhou , Tian Fang , Long Quan

Recent advancements in learning-based Multi-View Stereo (MVS) methods have prominently featured transformer-based models with attention mechanisms. However, existing approaches have not thoroughly investigated the profound influence of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenjie Cao , Xinlin Ren , Yanwei Fu

Almost all previous deep learning-based multi-view stereo (MVS) approaches focus on improving reconstruction quality. Besides quality, efficiency is also a desirable feature for MVS in real scenarios. Towards this end, this paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Zehao Yu , Shenghua Gao

The present Multi-view stereo (MVS) methods with supervised learning-based networks have an impressive performance comparing with traditional MVS methods. However, the ground-truth depth maps for training are hard to be obtained and are…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Baichuan Huang , Hongwei Yi , Can Huang , Yijia He , Jingbin Liu , Xiao Liu

Learning-based multi-view stereo (MVS) has gained fine reconstructions on popular datasets. However, supervised learning methods require ground truth for training, which is hard to be collected, especially for the large-scale datasets.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Haonan Dong , Jian Yao

The present Multi-view stereo (MVS) methods with supervised learning-based networks have an impressive performance comparing with traditional MVS methods. However, the ground-truth depth maps for training are hard to be obtained and are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Baichuan Huang , Hongwei Yi , Can Huang , Yijia He , Jingbin Liu , Xiao Liu

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xinyi Ye , Weiyue Zhao , Tianqi Liu , Zihao Huang , Zhiguo Cao , Xin Li

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

Bounded by the inherent ambiguity of depth perception, contemporary camera-based 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Yinhao Li , Han Bao , Zheng Ge , Jinrong Yang , Jianjian Sun , Zeming Li

In this paper, we propose a novel multi-view stereo (MVS) framework that gets rid of the depth range prior. Unlike recent prior-free MVS methods that work in a pair-wise manner, our method simultaneously considers all the source images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yitong Dong , Yijin Li , Zhaoyang Huang , Weikang Bian , Jingbo Liu , Hujun Bao , Zhaopeng Cui , Hongsheng Li , Guofeng Zhang

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D search problem within a valid depth range. Recent deep learning-based MVS methods typically densely sample depth hypotheses in the depth range, and then construct…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhenxing Mi , Di Chang , Dan Xu

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Junhua Xi , Yifei Shi , Yijie Wang , Yulan Guo , Kai Xu