English
Related papers

Related papers: Uncertainty-Aware Deep Multi-View Photometric Ster…

200 papers

Research on multi-view stereo based on remote sensing images has promoted the development of large-scale urban 3D reconstruction. However, remote sensing multi-view image data suffers from the problems of occlusion and uneven brightness…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yong-Qiang Mao , Hanbo Bi , Liangyu Xu , Kaiqiang Chen , Zhirui Wang , Xian Sun , Kun Fu

The success of existing deep-learning based multi-view stereo (MVS) approaches greatly depends on the availability of large-scale supervision in the form of dense depth maps. Such supervision, while not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Yuchao Dai , Zhidong Zhu , Zhibo Rao , Bo Li

We present Uncertainty-aware Cascaded Stereo Network (UCS-Net) for 3D reconstruction from multiple RGB images. Multi-view stereo (MVS) aims to reconstruct fine-grained scene geometry from multi-view images. Previous learning-based MVS…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Shuo Cheng , Zexiang Xu , Shilin Zhu , Zhuwen Li , Li Erran Li , Ravi Ramamoorthi , Hao Su

Photometric stereo, a problem of recovering 3D surface normals using images of an object captured under different lightings, has been of great interest and importance in computer vision research. Despite the success of existing traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Ashish Tiwari , Shanmuganathan Raman

Finding accurate correspondences among different views is the Achilles' heel of unsupervised Multi-View Stereo (MVS). Existing methods are built upon the assumption that corresponding pixels share similar photometric features. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Di Chang , Aljaž Božič , Tong Zhang , Qingsong Yan , Yingcong Chen , Sabine Süsstrunk , Matthias Nießner

Scene reconstruction from unorganized RGB images is an important task in many computer vision applications. Multi-view Stereo (MVS) is a common solution in photogrammetry applications for the dense reconstruction of a static scene. The…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Matthias Innmann , Kihwan Kim , Jinwei Gu , Matthias Niessner , Charles Loop , Marc Stamminger , Jan Kautz

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

We present a learning based approach for multi-view stereopsis (MVS). While current deep MVS methods achieve impressive results, they crucially rely on ground-truth 3D training data, and acquisition of such precise 3D geometry for…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Tejas Khot , Shubham Agrawal , Shubham Tulsiani , Christoph Mertz , Simon Lucey , Martial Hebert

Self-supervised Multi-view stereo (MVS) with a pretext task of image reconstruction has achieved significant progress recently. However, previous methods are built upon intuitions, lacking comprehensive explanations about the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Hongbin Xu , Zhipeng Zhou , Yali Wang , Wenxiong Kang , Baigui Sun , Hao Li , Yu Qiao

Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yakun Ju , Kin-Man Lam , Wuyuan Xie , Huiyu Zhou , Junyu Dong , Boxin Shi

PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is the first method…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Jinyu Zhao , Jumpei Oishi , Yusuke Monno , Masatoshi Okutomi

Recent work in multi-view stereo (MVS) combines learnable photometric scores and regularization with PatchMatch-based optimization to achieve robust pixelwise estimates of depth, normals, and visibility. However, non-learning based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Jae Yong Lee , Chuhang Zou , Derek Hoiem

This paper introduces a learnable Deformable Hypothesis Sampler (DeformSampler) to address the challenging issue of noisy depth estimation for accurate PatchMatch Multi-View Stereo (MVS). We observe that the heuristic depth hypothesis…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hongjie Li , Yao Guo , Xianwei Zheng , Hanjiang Xiong

Multi-view stereopsis (MVS) tries to recover the 3D model from 2D images. As the observations become sparser, the significant 3D information loss makes the MVS problem more challenging. Instead of only focusing on densely sampled…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Mengqi Ji , Jinzhi Zhang , Qionghai Dai , Lu Fang

Multi-view stereo methods have achieved great success for depth estimation based on the coarse-to-fine depth learning frameworks, however, the existing methods perform poorly in recovering the depth of object boundaries and detail regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haitao Tian , Junyang Li , Chenxing Wang , Helong Jiang

Integrating inverse rendering with multi-view photometric stereo (MVPS) yields more accurate 3D reconstructions than the inverse rendering approaches that rely on fixed environment illumination. However, efficient inverse rendering with…

Graphics · Computer Science 2025-07-25 Yixiao Chen , Bin Liang , Hanzhi Guo , Yongqing Cheng , Jiayi Zhao , Dongdong Weng

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xinyi Ye , Weiyue Zhao , Tianqi Liu , Zihao Huang , Zhiguo Cao , Xin Li

Traditional MVS methods have good accuracy but struggle with completeness, while recently developed learning-based multi-view stereo (MVS) techniques have improved completeness except accuracy being compromised. We propose depth…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Nail Ibrahimli , Hugo Ledoux , Julian Kooij , Liangliang Nan

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan

One of the most successful approaches in Multi-View Stereo estimates a depth map and a normal map for each view via PatchMatch-based optimization and fuses them into a consistent 3D points cloud. This approach relies on photo-consistency to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Andrea Romanoni , Matteo Matteucci