English
Related papers

Related papers: M^3VSNet: Unsupervised Multi-metric Multi-view Ste…

200 papers

This paper presents a simple and effective solution to the longstanding classical multi-view photometric stereo (MVPS) problem. It is well-known that photometric stereo (PS) is excellent at recovering high-frequency surface details, whereas…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xinyi Ye , Weiyue Zhao , Tianqi Liu , Zihao Huang , Zhiguo Cao , Xin Li

Self-supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground-truth depth, online fine-tuning, and better generalization with unlimited data attract researchers to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Weihao Yuan , Yazhan Zhang , Bingkun Wu , Siyu Zhu , Ping Tan , Michael Yu Wang , Qifeng Chen

We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth estimation network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Nan Yang , Lukas von Stumberg , Rui Wang , Daniel Cremers

The reconstruction of textureless areas has long been a challenging problem in MVS due to lack of reliable pixel correspondences between images. In this paper, we propose the Textureless-aware Segmentation And Correlative Refinement guided…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Zhenlong Yuan , Jiakai Cao , Zhaoqi Wang , Zhaoxin Li

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

We present a novel framework for mesh reconstruction from unstructured point clouds by taking advantage of the learned visibility of the 3D points in the virtual views and traditional graph-cut based mesh generation. Specifically, we first…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Shuang Song , Zhaopeng Cui , Rongjun Qin

As manipulating images by copy-move, splicing and/or inpainting may lead to misinterpretation of the visual content, detecting these sorts of manipulations is crucial for media forensics. Given the variety of possible attacks on the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Chengbo Dong , Xinru Chen , Ruohan Hu , Juan Cao , Xirong Li

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon

Despite the impressive performance of Multi-view Stereo (MVS) approaches given plenty of training samples, the performance degradation when generalizing to unseen domains has not been clearly explored yet. In this work, we focus on the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Hongbin Xu , Weitao Chen , Baigui Sun , Xuansong Xie , Wenxiong Kang

Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (HR) ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Jialei Xu , Yuanchao Bai , Xianming Liu , Junjun Jiang , Xiangyang Ji

Recently, patch deformation-based methods have demonstrated significant effectiveness in multi-view stereo due to their incorporation of deformable and expandable perception for reconstructing textureless areas. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Zhenlong Yuan , Dapeng Zhang , Zehao Li , Chengxuan Qian , Jianing Chen , Yinda Chen , Kehua Chen , Tianlu Mao , Zhaoxin Li , Hao Jiang , Zhaoqi Wang

Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent instance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Andra Petrovai , Sergiu Nedevschi

In deep multi-view stereo networks, cost regularization is crucial to achieve accurate depth estimation. Since 3D cost volume filtering is usually memory-consuming, recurrent 2D cost map regularization has recently become popular and has…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Qingshan Xu , Martin R. Oswald , Wenbing Tao , Marc Pollefeys , Zhaopeng Cui

Deep-learning metrics have recently demonstrated extremely good performance to match image patches for stereo reconstruction. However, training such metrics requires large amount of labeled stereo images, which can be difficult or costly to…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Stepan Tulyakov , Anton Ivanov , Francois Fleuret

Multi-view stereo (MVS) is the golden mean between the accuracy of active depth sensing and the practicality of monocular depth estimation. Cost volume based approaches employing 3D convolutional neural networks (CNNs) have considerably…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Ayan Sinha , Zak Murez , James Bartolozzi , Vijay Badrinarayanan , Andrew Rabinovich

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great success in large-scale scene reconstruction tasks. However, reconstruction of texture-less planes often fails as similarity measurement methods may become ineffective…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Shang Sun , Yunan Zheng , Xuelei Shi , Zhenyu Xu , Yiguang Liu

We propose a novel approach for deep learning-based Multi-View Stereo (MVS). For each pixel in the reference image, our method leverages a deep architecture to search for the corresponding point in the source image directly along the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Christian Sormann , Emanuele Santellani , Mattia Rossi , Andreas Kuhn , Friedrich Fraundorfer

We present Uncertainty-aware Cascaded Stereo Network (UCS-Net) for 3D reconstruction from multiple RGB images. Multi-view stereo (MVS) aims to reconstruct fine-grained scene geometry from multi-view images. Previous learning-based MVS…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Shuo Cheng , Zexiang Xu , Shilin Zhu , Zhuwen Li , Li Erran Li , Ravi Ramamoorthi , Hao Su