English
Related papers

Related papers: Multi-View Photometric Stereo Revisited

200 papers

Multispectral photometric stereo(MPS) aims at recovering the surface normal of a scene from a single-shot multispectral image captured under multispectral illuminations. Existing MPS methods adopt the Lambertian reflectance model to make…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jipeng Lv , Heng Guo , Guanying Chen , Jinxiu Liang , Boxin Shi

In this work we propose a novel, highly practical, binocular photometric stereo (PS) framework, which has same acquisition speed as single view PS, however significantly improves the quality of the estimated geometry. As in recent neural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Fotios Logothetis , Ignas Budvytis , Roberto Cipolla

There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Georgios Kopanas , Julien Philip , Thomas Leimkühler , George Drettakis

Highly accurate 3D volumetric reconstruction is still an open research topic where the main difficulty is usually related to merging some rough estimations with high frequency details. One of the most promising methods is the fusion between…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Fotios Logothetis , Roberto Mecca , Roberto Cipolla

We introduce a novel multi-view stereo (MVS) method that can simultaneously recover not just per-pixel depth but also surface normals, together with the reflectance of textureless, complex non-Lambertian surfaces captured under known but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Kohei Yamashita , Yuto Enyo , Shohei Nobuhara , Ko Nishino

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

Finding accurate correspondences among different views is the Achilles' heel of unsupervised Multi-View Stereo (MVS). Existing methods are built upon the assumption that corresponding pixels share similar photometric features. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Di Chang , Aljaž Božič , Tong Zhang , Qingsong Yan , Yingcong Chen , Sabine Süsstrunk , Matthias Nießner

Bounded by the inherent ambiguity of depth perception, contemporary camera-based 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Yinhao Li , Han Bao , Zheng Ge , Jinrong Yang , Jianjian Sun , Zeming Li

We introduce the first end-to-end learning-based solution to near-field Photometric Stereo (PS), where the light sources are close to the object of interest. This setup is especially useful for reconstructing large immobile objects. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Daniel Lichy , Soumyadip Sengupta , David W. Jacobs

Multi-view stereopsis (MVS) tries to recover the 3D model from 2D images. As the observations become sparser, the significant 3D information loss makes the MVS problem more challenging. Instead of only focusing on densely sampled…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Mengqi Ji , Jinzhi Zhang , Qionghai Dai , Lu Fang

Scene reconstruction from unorganized RGB images is an important task in many computer vision applications. Multi-view Stereo (MVS) is a common solution in photogrammetry applications for the dense reconstruction of a static scene. The…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Matthias Innmann , Kihwan Kim , Jinwei Gu , Matthias Niessner , Charles Loop , Marc Stamminger , Jan Kautz

Underwater scene reconstruction poses a substantial challenge because of the intricate interplay between light and the medium, resulting in scattering and absorption effects that make both depth estimation and rendering more complex. While…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shuyi Hu , Qi Liu

Recent work in multi-view stereo (MVS) combines learnable photometric scores and regularization with PatchMatch-based optimization to achieve robust pixelwise estimates of depth, normals, and visibility. However, non-learning based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Jae Yong Lee , Chuhang Zou , Derek Hoiem

Learning-based Multi-View Stereo (MVS) methods warp source images into the reference camera frustum to form 3D volumes, which are fused as a cost volume to be regularized by subsequent networks. The fusing step plays a vital role in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Xiaofeng Wang , Zheng Zhu , Fangbo Qin , Yun Ye , Guan Huang , Xu Chi , Yijia He , Xingang Wang

This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Baptiste Brument , Robin Bruneau , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis , Jean-Denis Durou , Lilian Calvet

Bounded by the inherent ambiguity of depth perception, contemporary multi-view 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yinhao Li , Jinrong Yang , Jianjian Sun , Han Bao , Zheng Ge , Li Xiao

We present MVSGaussian, a new generalizable 3D Gaussian representation approach derived from Multi-View Stereo (MVS) that can efficiently reconstruct unseen scenes. Specifically, 1) we leverage MVS to encode geometry-aware Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianqi Liu , Guangcong Wang , Shoukang Hu , Liao Shen , Xinyi Ye , Yuhang Zang , Zhiguo Cao , Wei Li , Ziwei Liu

Learning neural implicit surfaces from volume rendering has become popular for multi-view reconstruction. Neural surface reconstruction approaches can recover complex 3D geometry that are difficult for classical Multi-view Stereo (MVS)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Mohamed Shawky Sabae , Hoda Anis Baraka , Mayada Mansour Hadhoud

GigaMVS presents several challenges to existing Multi-View Stereo (MVS) algorithms for its large scale, complex occlusions, and gigapixel images. To address these problems, we first apply one of the state-of-the-art learning-based MVS…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Chenjie Cao , Xinlin Ren , Xiangyang Xue , Yanwei Fu

In this work, we propose a novel approach to prioritize the depth map computation of multi-view stereo (MVS) to obtain compact 3D point clouds of high quality and completeness at low computational cost. Our prioritization approach operates…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Christian Mostegel , Friedrich Fraundorfer , Horst Bischof