English
Related papers

Related papers: BlendedMVS: A Large-scale Dataset for Generalized …

200 papers

The photometric stereo (PS) problem consists in reconstructing the 3D-surface of an object, thanks to a set of photographs taken under different lighting directions. In this paper, we propose a multi-scale architecture for PS which,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Clément Hardy , Yvain Quéau , David Tschumperlé

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan

This paper proposes a network, referred to as MVSTR, for Multi-View Stereo (MVS). It is built upon Transformer and is capable of extracting dense features with global context and 3D consistency, which are crucial to achieving reliable…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jie Zhu , Bo Peng , Wanqing Li , Haifeng Shen , Zhe Zhang , Jianjun Lei

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yao Yao , Zixin Luo , Shiwei Li , Tian Fang , Long Quan

The present Multi-view stereo (MVS) methods with supervised learning-based networks have an impressive performance comparing with traditional MVS methods. However, the ground-truth depth maps for training are hard to be obtained and are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Baichuan Huang , Hongwei Yi , Can Huang , Yijia He , Jingbin Liu , Xiao Liu

The present Multi-view stereo (MVS) methods with supervised learning-based networks have an impressive performance comparing with traditional MVS methods. However, the ground-truth depth maps for training are hard to be obtained and are…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Baichuan Huang , Hongwei Yi , Can Huang , Yijia He , Jingbin Liu , Xiao Liu

Significant strides have been made in enhancing the accuracy of Multi-View Stereo (MVS)-based 3D reconstruction. However, untextured areas with unstable photometric consistency often remain incompletely reconstructed. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Rongxuan Tan , Qing Wang , Xueyan Wang , Chao Yan , Yang Sun , Youyang Feng

Single-view depth prediction is a fundamental problem in computer vision. Recently, deep learning methods have led to significant progress, but such methods are limited by the available training data. Current datasets based on 3D sensors…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Zhengqi Li , Noah Snavely

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

We present a learning based approach for multi-view stereopsis (MVS). While current deep MVS methods achieve impressive results, they crucially rely on ground-truth 3D training data, and acquisition of such precise 3D geometry for…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Tejas Khot , Shubham Agrawal , Shubham Tulsiani , Christoph Mertz , Simon Lucey , Martial Hebert

This paper introduces a novel deep framework for dense 3D reconstruction from multiple image frames, leveraging a sparse set of depth measurements gathered jointly with image acquisition. Given a deep multi-view stereo network, our…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Matteo Poggi , Andrea Conti , Stefano Mattoccia

We propose a learning-based network for depth map estimation from multi-view stereo (MVS) images. Our proposed network consists of three sub-networks: 1) a base network for initial depth map estimation from an unstructured stereo image…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sizhang Dai , Weibing Huang

A great deal of research has demonstrated recently that multi-view stereo (MVS) matching can be solved with deep learning methods. However, these efforts were focused on close-range objects and only a very few of the deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Jin Liu , Shunping Ji

We introduce Point-MVSNet, a novel point-based deep framework for multi-view stereo (MVS). Distinct from existing cost volume approaches, our method directly processes the target scene as point clouds. More specifically, our method predicts…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Rui Chen , Songfang Han , Jing Xu , Hao Su

Multi-view photometric stereo (MVPS) is a preferred method for detailed and precise 3D acquisition of an object from images. Although popular methods for MVPS can provide outstanding results, they are often complex to execute and limited to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

We introduce a learning-based depth map fusion framework that accepts a set of depth and confidence maps generated by a Multi-View Stereo (MVS) algorithm as input and improves them. This is accomplished by integrating volumetric visibility…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Nathaniel Burgdorfer , Philippos Mordohai

In this paper, we propose a novel end-to-end deep neural network model for omnidirectional depth estimation from a wide-baseline multi-view stereo setup. The images captured with ultra wide field-of-view (FOV) cameras on an omnidirectional…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Changhee Won , Jongbin Ryu , Jongwoo Lim

We propose an online multi-view depth prediction approach on posed video streams, where the scene geometry information computed in the previous time steps is propagated to the current time step in an efficient and geometrically plausible…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Arda Düzçeker , Silvano Galliani , Christoph Vogel , Pablo Speciale , Mihai Dusmanu , Marc Pollefeys

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon