English
Related papers

Related papers: MVS^2: Deep Unsupervised Multi-view Stereo with Mu…

200 papers

3D reconstruction aims to recover the dense 3D structure of a scene. It plays an essential role in various applications such as Augmented/Virtual Reality (AR/VR), autonomous driving and robotics. Leveraging multiple views of a scene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Fangjinhua Wang , Qingtian Zhu , Di Chang , Quankai Gao , Junlin Han , Tong Zhang , Richard Hartley , Marc Pollefeys

Traditional multi-view stereo (MVS) methods rely heavily on photometric and geometric consistency constraints, but newer machine learning-based MVS methods check geometric consistency across multiple source views only as a post-processing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Vibhas K. Vats , Sripad Joshi , David J. Crandall , Md. Alimoor Reza , Soon-heung Jung

Significant progress has been witnessed in learning-based Multi-view Stereo (MVS) under supervised and unsupervised settings. To combine their respective merits in accuracy and completeness, meantime reducing the demand for expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hongbin Xu , Weitao Chen , Yang Liu , Zhipeng Zhou , Haihong Xiao , Baigui Sun , Xuansong Xie , Wenxiong Kang

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yao Yao , Zixin Luo , Shiwei Li , Tian Fang , Long Quan

3D scene reconstruction from multiple views is an important classical problem in computer vision. Deep learning based approaches have recently demonstrated impressive reconstruction results. When training such models, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Arijit Mallick , Jörg Stückler , Hendrik Lensch

We show how to train a fully convolutional neural network to perform inverse rendering from a single, uncontrolled image. The network takes an RGB image as input, regresses albedo and normal maps from which we compute lighting coefficients.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Ye Yu , William A. P. Smith

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D search problem within a valid depth range. Recent deep learning-based MVS methods typically densely sample depth hypotheses in the depth range, and then construct…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhenxing Mi , Di Chang , Dan Xu

Deep learning-based multi-view stereo has emerged as a powerful paradigm for reconstructing the complete geometrically-detailed objects from multi-views. Most of the existing approaches only estimate the pixel-wise depth value by minimizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Yisu Zhang , Jianke Zhu , Lixiang Lin

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Junhua Xi , Yifei Shi , Yijie Wang , Yulan Guo , Kai Xu

Learning-based Multi-View Stereo (MVS) methods have made remarkable progress in recent years. However, how to effectively train the network without using real-world labels remains a challenging problem. In this paper, driven by the recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Jie Zhu , Bo Peng , Zhe Zhang , Bingzheng Liu , Jianjun Lei

In this paper, we propose a novel multi-view stereo (MVS) framework that gets rid of the depth range prior. Unlike recent prior-free MVS methods that work in a pair-wise manner, our method simultaneously considers all the source images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yitong Dong , Yijin Li , Zhaoyang Huang , Weikang Bian , Jingbo Liu , Hujun Bao , Zhaopeng Cui , Hongsheng Li , Guofeng Zhang

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xinyi Ye , Weiyue Zhao , Tianqi Liu , Zihao Huang , Zhiguo Cao , Xin Li

3D reconstruction has lately attracted increasing attention due to its wide application in many areas, such as autonomous driving, robotics and virtual reality. As a dominant technique in artificial intelligence, deep learning has been…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Qingtian Zhu , Chen Min , Zizhuang Wei , Yisong Chen , Guoping Wang

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan

At present, deep learning has been applied more and more in monocular image depth estimation and has shown promising results. The current more ideal method for monocular depth estimation is the supervised learning based on ground truth…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Zhimin Zhang , Jianzhong Qiao , Shukuan Lin

In this paper, we propose a novel end-to-end deep neural network model for omnidirectional depth estimation from a wide-baseline multi-view stereo setup. The images captured with ultra wide field-of-view (FOV) cameras on an omnidirectional…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Changhee Won , Jongbin Ryu , Jongwoo Lim

This paper presents a simple and effective solution to the longstanding classical multi-view photometric stereo (MVPS) problem. It is well-known that photometric stereo (PS) is excellent at recovering high-frequency surface details, whereas…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

Supervised multi-view stereo (MVS) methods have achieved remarkable progress in terms of reconstruction quality, but suffer from the challenge of collecting large-scale ground-truth depth. In this paper, we propose a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yikang Ding , Qingtian Zhu , Xiangyue Liu , Wentao Yuan , Haotian Zhang , Chi Zhang

In this paper we show how to perform scene-level inverse rendering to recover shape, reflectance and lighting from a single, uncontrolled image using a fully convolutional neural network. The network takes an RGB image as input, regresses…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Ye Yu , William A. P. Smith