English
Related papers

Related papers: RayMVSNet: Learning Ray-based 1D Implicit Fields f…

200 papers

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon

Recent learning-based multi-view stereo (MVS) methods show excellent performance with dense cameras and small depth ranges. However, non-learning based approaches still outperform for scenes with large depth ranges and sparser wide-baseline…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Jae Yong Lee , Joseph DeGol , Chuhang Zou , Derek Hoiem

We propose a novel approach for deep learning-based Multi-View Stereo (MVS). For each pixel in the reference image, our method leverages a deep architecture to search for the corresponding point in the source image directly along the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Christian Sormann , Emanuele Santellani , Mattia Rossi , Andreas Kuhn , Friedrich Fraundorfer

We propose a cost volume-based neural network for depth inference from multi-view images. We demonstrate that building a cost volume pyramid in a coarse-to-fine manner instead of constructing a cost volume at a fixed resolution leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jiayu Yang , Wei Mao , Jose M. Alvarez , Miaomiao Liu

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

We propose a learning-based network for depth map estimation from multi-view stereo (MVS) images. Our proposed network consists of three sub-networks: 1) a base network for initial depth map estimation from an unstructured stereo image…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sizhang Dai , Weibing Huang

Recent supervised multi-view depth estimation networks have achieved promising results. Similar to all supervised approaches, these networks require ground-truth data during training. However, collecting a large amount of multi-view depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Jiayu Yang , Jose M. Alvarez , Miaomiao Liu

Learning-based Multi-View Stereo (MVS) methods have made remarkable progress in recent years. However, how to effectively train the network without using real-world labels remains a challenging problem. In this paper, driven by the recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Jie Zhu , Bo Peng , Zhe Zhang , Bingzheng Liu , Jianjun Lei

We present a learning based approach for multi-view stereopsis (MVS). While current deep MVS methods achieve impressive results, they crucially rely on ground-truth 3D training data, and acquisition of such precise 3D geometry for…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Tejas Khot , Shubham Agrawal , Shubham Tulsiani , Christoph Mertz , Simon Lucey , Martial Hebert

Deep learning has made significant impacts on multi-view stereo systems. State-of-the-art approaches typically involve building a cost volume, followed by multiple 3D convolution operations to recover the input image's pixel-wise depth.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Zhenpei Yang , Zhile Ren , Qi Shan , Qixing Huang

While deep learning has recently achieved great success on multi-view stereo (MVS), limited training data makes the trained model hard to be generalized to unseen scenarios. Compared with other computer vision tasks, it is rather difficult…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yao Yao , Zixin Luo , Shiwei Li , Jingyang Zhang , Yufan Ren , Lei Zhou , Tian Fang , Long Quan

Recent cost volume pyramid based deep neural networks have unlocked the potential of efficiently leveraging high-resolution images for depth inference from multi-view stereo. In general, those approaches assume that the depth of each pixel…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Jiayu Yang , Jose M. Alvarez , Miaomiao Liu

Deep Neural Networks (DNNs) have the potential to improve the quality of image-based 3D reconstructions. However, the use of DNNs in the context of 3D reconstruction from large and high-resolution image datasets is still an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Andreas Kuhn , Christian Sormann , Mattia Rossi , Oliver Erdler , Friedrich Fraundorfer

Existing learning-based multi-view stereo (MVS) methods rely on the depth range to build the 3D cost volume and may fail when the range is too large or unreliable. To address this problem, we propose a disparity-based MVS method based on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Bo Li , Xiaowen Chu , Fei Deng

In this work, we propose a novel approach to prioritize the depth map computation of multi-view stereo (MVS) to obtain compact 3D point clouds of high quality and completeness at low computational cost. Our prioritization approach operates…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Christian Mostegel , Friedrich Fraundorfer , Horst Bischof

Recovering detailed facial geometry from a set of calibrated multi-view images is valuable for its wide range of applications. Traditional multi-view stereo (MVS) methods adopt an optimization-based scheme to regularize the matching cost.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yunze Xiao , Hao Zhu , Haotian Yang , Zhengyu Diao , Xiangju Lu , Xun Cao

We present MVLayoutNet, an end-to-end network for holistic 3D reconstruction from multi-view panoramas. Our core contribution is to seamlessly combine learned monocular layout estimation and multi-view stereo (MVS) for accurate layout…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Zhihua Hu , Bo Duan , Yanfeng Zhang , Mingwei Sun , Jingwei Huang

Traditional multi-view stereo (MVS) methods rely heavily on photometric and geometric consistency constraints, but newer machine learning-based MVS methods check geometric consistency across multiple source views only as a post-processing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Vibhas K. Vats , Sripad Joshi , David J. Crandall , Md. Alimoor Reza , Soon-heung Jung

Recently, learning-based multi-view stereo methods have achieved promising results. However, they all overlook the visibility difference among different views, which leads to an indiscriminate multi-view similarity definition and greatly…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Qingshan Xu , Wenbing Tao

Different from most state-of-the-art~(SOTA) algorithms that use static and uniform sampling methods with a lot of hypothesis planes to get fine depth sampling. In this paper, we propose a free-moving hypothesis plane method for dynamic and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Tao Zhang