English
Related papers

Related papers: nLMVS-Net: Deep Non-Lambertian Multi-View Stereo

200 papers

This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Baptiste Brument , Robin Bruneau , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis , Jean-Denis Durou , Lilian Calvet

Traditional MVS methods have good accuracy but struggle with completeness, while recently developed learning-based multi-view stereo (MVS) techniques have improved completeness except accuracy being compromised. We propose depth…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Nail Ibrahimli , Hugo Ledoux , Julian Kooij , Liangliang Nan

We present an efficient multi-view stereo (MVS) network for 3D reconstruction from multiview images. While previous learning based reconstruction approaches performed quite well, most of them estimate depth maps at a fixed resolution using…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Anzhu Yu , Wenyue Guo , Bing Liu , Xin Chen , Xin Wang , Xuefeng Cao , Bingchuan Jiang

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

Recent learning-based multi-view stereo (MVS) methods show excellent performance with dense cameras and small depth ranges. However, non-learning based approaches still outperform for scenes with large depth ranges and sparser wide-baseline…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Jae Yong Lee , Joseph DeGol , Chuhang Zou , Derek Hoiem

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yao Yao , Zixin Luo , Shiwei Li , Tian Fang , Long Quan

We propose a learning-based network for depth map estimation from multi-view stereo (MVS) images. Our proposed network consists of three sub-networks: 1) a base network for initial depth map estimation from an unstructured stereo image…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sizhang Dai , Weibing Huang

Learning-based multi-view stereo (MVS) has gained fine reconstructions on popular datasets. However, supervised learning methods require ground truth for training, which is hard to be collected, especially for the large-scale datasets.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Haonan Dong , Jian Yao

This paper addresses the problem of photometric stereo, in both calibrated and uncalibrated scenarios, for non-Lambertian surfaces based on deep learning. We first introduce a fully convolutional deep network for calibrated photometric…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Guanying Chen , Kai Han , Boxin Shi , Yasuyuki Matsushita , Kwan-Yee K. Wong

We present a novel convolutional neural network architecture for photometric stereo (Woodham, 1980), a problem of recovering 3D object surface normals from multiple images observed under varying illuminations. Despite its long history in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Tatsunori Taniai , Takanori Maehara

In this paper we show how to perform scene-level inverse rendering to recover shape, reflectance and lighting from a single, uncontrolled image using a fully convolutional neural network. The network takes an RGB image as input, regresses…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Ye Yu , William A. P. Smith

Unsupervised Multi-View Stereo (MVS) methods have achieved promising progress recently. However, previous methods primarily depend on the photometric consistency assumption, which may suffer from two limitations: indistinguishable regions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Kaiqiang Xiong , Rui Peng , Zhe Zhang , Tianxing Feng , Jianbo Jiao , Feng Gao , Ronggang Wang

Photometric stereo provides an important method for high-fidelity 3D reconstruction based on multiple intensity images captured under different illumination directions. In this paper, we present a complete framework, including a multilight…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yanlong Cao , Binjie Ding , Zewei He , Jiangxin Yang , Jingxi Chen , Yanpeng Cao , Xin Li

Underwater scene reconstruction poses a substantial challenge because of the intricate interplay between light and the medium, resulting in scattering and absorption effects that make both depth estimation and rendering more complex. While…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shuyi Hu , Qi Liu

We propose a fast and generalizable solution to Multi-view Photometric Stereo (MVPS), called MVPSNet. The key to our approach is a feature extraction network that effectively combines images from the same view captured under multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Dongxu Zhao , Daniel Lichy , Pierre-Nicolas Perrin , Jan-Michael Frahm , Soumyadip Sengupta

This paper presents a learning-based method for multi-view depth estimation from posed images. Our core idea is a "learning-to-optimize" paradigm that iteratively indexes a plane-sweeping cost volume and regresses the depth map via a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Changjiang Cai , Pan Ji , Qingan Yan , Yi Xu

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

n this paper, we propose an effective and efficient pyramid multi-view stereo (MVS) net with self-adaptive view aggregation for accurate and complete dense point cloud reconstruction. Different from using mean square variance to generate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Hongwei Yi , Zizhuang Wei , Mingyu Ding , Runze Zhang , Yisong Chen , Guoping Wang , Yu-Wing Tai

Almost all previous deep learning-based multi-view stereo (MVS) approaches focus on improving reconstruction quality. Besides quality, efficiency is also a desirable feature for MVS in real scenarios. Towards this end, this paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Zehao Yu , Shenghua Gao

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan