English
Related papers

Related papers: How Good MVSNets Are at Depth Fusion

200 papers

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon

Including information from additional spectral bands (e.g., near-infrared) can improve deep learning model performance for many vision-oriented tasks. There are many possible ways to incorporate this additional information into a deep…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Charles Godfrey , Elise Bishoff , Myles McKay , Eleanor Byler

Deep learning has made significant impacts on multi-view stereo systems. State-of-the-art approaches typically involve building a cost volume, followed by multiple 3D convolution operations to recover the input image's pixel-wise depth.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Zhenpei Yang , Zhile Ren , Qi Shan , Qixing Huang

Deep learning has recently demonstrated its excellent performance on the task of multi-view stereo (MVS). However, loss functions applied for deep MVS are rarely studied. In this paper, we first analyze existing loss functions' properties…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qinglu Min , Jie Zhao , Zhihao Zhang , Chen Min

To reconstruct the 3D geometry from calibrated images, learning-based multi-view stereo (MVS) methods typically perform multi-view depth estimation and then fuse depth maps into a mesh or point cloud. To improve the computational…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Fangjinhua Wang , Qingshan Xu , Yew-Soon Ong , Marc Pollefeys

3D reconstruction aims to recover the dense 3D structure of a scene. It plays an essential role in various applications such as Augmented/Virtual Reality (AR/VR), autonomous driving and robotics. Leveraging multiple views of a scene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Fangjinhua Wang , Qingtian Zhu , Di Chang , Quankai Gao , Junlin Han , Tong Zhang , Richard Hartley , Marc Pollefeys

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yifei Shi , Junhua Xi , Dewen Hu , Zhiping Cai , Kai Xu

Previous monocular depth estimation methods take a single view and directly regress the expected results. Though recent advances are made by applying geometrically inspired loss functions during training, the inference procedure does not…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Yue Luo , Jimmy Ren , Mude Lin , Jiahao Pang , Wenxiu Sun , Hongsheng Li , Liang Lin

Deep neural networks have shown excellent performance in stereo matching task. Recently CNN-based methods have shown that stereo matching can be formulated as a supervised learning task. However, less attention is paid on the fusion of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Li Zhang , Quanhong Wang , Haihua Lu , Yong Zhao

Recent studies have witnessed that self-supervised methods based on view synthesis obtain clear progress on multi-view stereo (MVS). However, existing methods rely on the assumption that the corresponding points among different views share…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hongbin Xu , Zhipeng Zhou , Yu Qiao , Wenxiong Kang , Qiuxia Wu

Limited by the cost and technology, the resolution of depth map collected by depth camera is often lower than that of its associated RGB camera. Although there have been many researches on RGB image super-resolution (SR), a major problem…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Chuhua Xian , Kun Qian , Zitian Zhang , Charlie C. L. Wang

Stereo matching is vital in 3D computer vision, with most algorithms assuming symmetric visual properties between binocular visions. However, the rise of asymmetric multi-camera systems (e.g., tele-wide cameras) challenges this assumption…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yuanting Gao , Linghao Shen

Traditional multi-view stereo (MVS) methods rely heavily on photometric and geometric consistency constraints, but newer machine learning-based MVS methods check geometric consistency across multiple source views only as a post-processing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Vibhas K. Vats , Sripad Joshi , David J. Crandall , Md. Alimoor Reza , Soon-heung Jung

Self-supervised learning for depth estimation uses geometry in image sequences for supervision and shows promising results. Like many computer vision tasks, depth network performance is determined by the capability to learn accurate spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Hang Zhou , David Greenwood , Sarah Taylor

Stereo matching is one of the widely used techniques for inferring depth from stereo images owing to its robustness and speed. It has become one of the major topics of research since it finds its applications in autonomous driving, robotic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Viny Saajan Victor , Peter Neigel

Recent advances in end-to-end unsupervised learning has significantly improved the performance of monocular depth prediction and alleviated the requirement of ground truth depth. Although a plethora of work has been done in enforcing…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Vinay Kaushik , Brejesh Lall

Consumer-grade music recordings such as those captured by mobile devices typically contain distortions in the form of background noise, reverb, and microphone-induced EQ. This paper presents a deep learning approach to enhance low-quality…

Sound · Computer Science 2022-04-29 Nikhil Kandpal , Oriol Nieto , Zeyu Jin

Supervised learning with deep convolutional neural networks (DCNNs) has seen huge adoption in stereo matching. However, the acquisition of large-scale datasets with well-labeled ground truth is cumbersome and labor-intensive, making…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Hengli Wang , Rui Fan , Peide Cai , Ming Liu

Deep Neural Networks (DNNs) have the potential to improve the quality of image-based 3D reconstructions. However, the use of DNNs in the context of 3D reconstruction from large and high-resolution image datasets is still an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Andreas Kuhn , Christian Sormann , Mattia Rossi , Oliver Erdler , Friedrich Fraundorfer

It is well known that the passive stereo system cannot adapt well to weak texture objects, e.g., white walls. However, these weak texture targets are very common in indoor environments. In this paper, we present a novel stereo system, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yuhua Xu , Xiaoli Yang , Yushan Yu , Wei Jia , Zhaobi Chu , Yulan Guo