English
Related papers

Related papers: Multi-View Photometric Stereo Revisited

200 papers

In this paper, we propose a novel multi-view stereo (MVS) framework that gets rid of the depth range prior. Unlike recent prior-free MVS methods that work in a pair-wise manner, our method simultaneously considers all the source images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yitong Dong , Yijin Li , Zhaoyang Huang , Weikang Bian , Jingbo Liu , Hujun Bao , Zhaopeng Cui , Hongsheng Li , Guofeng Zhang

This study addresses the challenge of online 3D model generation for neural rendering using an RGB image stream. Previous research has tackled this issue by incorporating Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS) as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Byeonggwon Lee , Junkyu Park , Khang Truong Giang , Sungho Jo , Soohwan Song

We present an efficient multi-view stereo (MVS) network for 3D reconstruction from multiview images. While previous learning based reconstruction approaches performed quite well, most of them estimate depth maps at a fixed resolution using…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Anzhu Yu , Wenyue Guo , Bing Liu , Xin Chen , Xin Wang , Xuefeng Cao , Bingchuan Jiang

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan

Deep learning-based multi-view stereo has emerged as a powerful paradigm for reconstructing the complete geometrically-detailed objects from multi-views. Most of the existing approaches only estimate the pixel-wise depth value by minimizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Yisu Zhang , Jianke Zhu , Lixiang Lin

While deep learning has recently achieved great success on multi-view stereo (MVS), limited training data makes the trained model hard to be generalized to unseen scenarios. Compared with other computer vision tasks, it is rather difficult…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yao Yao , Zixin Luo , Shiwei Li , Jingyang Zhang , Yufan Ren , Lei Zhou , Tian Fang , Long Quan

Neural approaches have shown a significant progress on camera-based reconstruction. But they require either a fairly dense sampling of the viewing sphere, or pre-training on an existing dataset, thereby limiting their generalizability. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mohammed Brahimi , Bjoern Haefner , Zhenzhang Ye , Bastian Goldluecke , Daniel Cremers

Traditional MVS methods have good accuracy but struggle with completeness, while recently developed learning-based multi-view stereo (MVS) techniques have improved completeness except accuracy being compromised. We propose depth…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Nail Ibrahimli , Hugo Ledoux , Julian Kooij , Liangliang Nan

The biggest improvements in Photometric Stereo (PS) field has recently come from adoption of differentiable volumetric rendering techniques such as NeRF or Neural SDF achieving impressive reconstruction error of 0.2mm on DiLiGenT-MV…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Fotios Logothetis , Ignas Budvytis , Stephan Liwicki , Roberto Cipolla

The present Multi-view stereo (MVS) methods with supervised learning-based networks have an impressive performance comparing with traditional MVS methods. However, the ground-truth depth maps for training are hard to be obtained and are…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Baichuan Huang , Hongwei Yi , Can Huang , Yijia He , Jingbin Liu , Xiao Liu

The present Multi-view stereo (MVS) methods with supervised learning-based networks have an impressive performance comparing with traditional MVS methods. However, the ground-truth depth maps for training are hard to be obtained and are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Baichuan Huang , Hongwei Yi , Can Huang , Yijia He , Jingbin Liu , Xiao Liu

We introduce an approach for selecting objects in neural volumetric 3D representations, such as multi-plane images (MPI) and neural radiance fields (NeRF). Our approach takes a set of foreground and background 2D user scribbles in one view…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhongzheng Ren , Aseem Agarwala , Bryan Russell , Alexander G. Schwing , Oliver Wang

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

Photogrammetric 3D reconstruction has long relied on traditional Structure-from-Motion (SfM) and Multi-View Stereo (MVS) methods, which provide high accuracy but face challenges in speed and scalability. Recently, learning-based MVS methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yawen Li , George Vosselman , Francesco Nex

3D reconstruction has lately attracted increasing attention due to its wide application in many areas, such as autonomous driving, robotics and virtual reality. As a dominant technique in artificial intelligence, deep learning has been…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Qingtian Zhu , Chen Min , Zizhuang Wei , Yisong Chen , Guoping Wang

We introduce a learning-based depth map fusion framework that accepts a set of depth and confidence maps generated by a Multi-View Stereo (MVS) algorithm as input and improves them. This is accomplished by integrating volumetric visibility…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Nathaniel Burgdorfer , Philippos Mordohai

With the emergence of neural radiance fields (NeRFs), view synthesis quality has reached an unprecedented level. Compared to traditional mesh-based assets, this volumetric representation is more powerful in expressing scene geometry but…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yuan-Chen Guo , Yan-Pei Cao , Chen Wang , Yu He , Ying Shan , Xiaohu Qie , Song-Hai Zhang

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D search problem within a valid depth range. Recent deep learning-based MVS methods typically densely sample depth hypotheses in the depth range, and then construct…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhenxing Mi , Di Chang , Dan Xu