English
Related papers

Related papers: Multi-View Stereo Representation Revisit: Region-A…

200 papers

A great deal of research has demonstrated recently that multi-view stereo (MVS) matching can be solved with deep learning methods. However, these efforts were focused on close-range objects and only a very few of the deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Jin Liu , Shunping Ji

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xinyi Ye , Weiyue Zhao , Tianqi Liu , Zihao Huang , Zhiguo Cao , Xin Li

GigaMVS presents several challenges to existing Multi-View Stereo (MVS) algorithms for its large scale, complex occlusions, and gigapixel images. To address these problems, we first apply one of the state-of-the-art learning-based MVS…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Chenjie Cao , Xinlin Ren , Xiangyang Xue , Yanwei Fu

To obtain high-resolution depth maps, some previous learning-based multi-view stereo methods build a cost volume pyramid in a coarse-to-fine manner. These approaches leverage fixed depth range hypotheses to construct cascaded plane sweep…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Puyuan Yi , Shengkun Tang , Jian Yao

3D reconstruction has lately attracted increasing attention due to its wide application in many areas, such as autonomous driving, robotics and virtual reality. As a dominant technique in artificial intelligence, deep learning has been…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Qingtian Zhu , Chen Min , Zizhuang Wei , Yisong Chen , Guoping Wang

Multi-view Stereo (MVS) aims to estimate depth and reconstruct 3D point clouds from a series of overlapping images. Recent learning-based MVS frameworks overlook the geometric information embedded in features and correlations, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuxi Hu , Jun Zhang , Zhe Zhang , Rafael Weilharter , Yuchen Rao , Kuangyi Chen , Runze Yuan , Friedrich Fraundorfer

One of the most successful approaches in Multi-View Stereo estimates a depth map and a normal map for each view via PatchMatch-based optimization and fuses them into a consistent 3D points cloud. This approach relies on photo-consistency to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Andrea Romanoni , Matteo Matteucci

Recent supervised multi-view depth estimation networks have achieved promising results. Similar to all supervised approaches, these networks require ground-truth data during training. However, collecting a large amount of multi-view depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Jiayu Yang , Jose M. Alvarez , Miaomiao Liu

We propose an online multi-view depth prediction approach on posed video streams, where the scene geometry information computed in the previous time steps is propagated to the current time step in an efficient and geometrically plausible…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Arda Düzçeker , Silvano Galliani , Christoph Vogel , Pablo Speciale , Mihai Dusmanu , Marc Pollefeys

In this paper we present ActiveStereoNet, the first deep learning solution for active stereo systems. Due to the lack of ground truth, our method is fully self-supervised, yet it produces precise depth with a subpixel precision of $1/30th$…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yinda Zhang , Sameh Khamis , Christoph Rhemann , Julien Valentin , Adarsh Kowdle , Vladimir Tankovich , Michael Schoenberg , Shahram Izadi , Thomas Funkhouser , Sean Fanello

Underwater scene reconstruction poses a substantial challenge because of the intricate interplay between light and the medium, resulting in scattering and absorption effects that make both depth estimation and rendering more complex. While…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shuyi Hu , Qi Liu

In recent years, supervised or unsupervised learning-based MVS methods achieved excellent performance compared with traditional methods. However, these methods only use the probability volume computed by cost volume regularization to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jingliang Li , Zhengda Lu , Yiqun Wang , Ying Wang , Jun Xiao

We propose Differentiable Stereopsis, a multi-view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end-to-end model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shubham Goel , Georgia Gkioxari , Jitendra Malik

Learning accurate depth is essential to multi-view 3D object detection. Recent approaches mainly learn depth from monocular images, which confront inherent difficulties due to the ill-posed nature of monocular depth learning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zengran Wang , Chen Min , Zheng Ge , Yinhao Li , Zeming Li , Hongyu Yang , Di Huang

Deep Neural Networks (DNNs) have the potential to improve the quality of image-based 3D reconstructions. However, the use of DNNs in the context of 3D reconstruction from large and high-resolution image datasets is still an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Andreas Kuhn , Christian Sormann , Mattia Rossi , Oliver Erdler , Friedrich Fraundorfer

Deep learning has made significant impacts on multi-view stereo systems. State-of-the-art approaches typically involve building a cost volume, followed by multiple 3D convolution operations to recover the input image's pixel-wise depth.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Zhenpei Yang , Zhile Ren , Qi Shan , Qixing Huang

Multi-view photometric stereo (MVPS) is a preferred method for detailed and precise 3D acquisition of an object from images. Although popular methods for MVPS can provide outstanding results, they are often complex to execute and limited to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

Deep learning has shown to be effective for depth inference in multi-view stereo (MVS). However, the scalability and accuracy still remain an open problem in this domain. This can be attributed to the memory-consuming cost volume…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Qingshan Xu , Wenbing Tao

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan