English
Related papers

Related papers: RayMVSNet++: Learning Ray-based 1D Implicit Fields…

200 papers

Recent learning-based multi-view stereo (MVS) methods show excellent performance with dense cameras and small depth ranges. However, non-learning based approaches still outperform for scenes with large depth ranges and sparser wide-baseline…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Jae Yong Lee , Joseph DeGol , Chuhang Zou , Derek Hoiem

Efficient and accurate 3D reconstruction is crucial for various applications, including augmented and virtual reality, medical imaging, and cinematic special effects. While traditional Multi-View Stereo (MVS) systems have been fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Umair Haroon , Ahmad AlMughrabi , Ricardo Marques , Petia Radeva

Bounded by the inherent ambiguity of depth perception, contemporary multi-view 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yinhao Li , Jinrong Yang , Jianjian Sun , Han Bao , Zheng Ge , Li Xiao

We present MVLayoutNet, an end-to-end network for holistic 3D reconstruction from multi-view panoramas. Our core contribution is to seamlessly combine learned monocular layout estimation and multi-view stereo (MVS) for accurate layout…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Zhihua Hu , Bo Duan , Yanfeng Zhang , Mingwei Sun , Jingwei Huang

Depth estimation is solved as a regression or classification problem in existing learning-based multi-view stereo methods. Although these two representations have recently demonstrated their excellent performance, they still have apparent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Rui Peng , Rongjie Wang , Zhenyu Wang , Yawen Lai , Ronggang Wang

Multi-View Stereo (MVS) is a core task in 3D computer vision. With the surge of novel deep learning methods, learned MVS has surpassed the accuracy of classical approaches, but still relies on building a memory intensive dense cost volume.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Radu Alexandru Rosu , Sven Behnke

In this paper, we present a novel recurrent multi-view stereo network based on long short-term memory (LSTM) with adaptive aggregation, namely AA-RMVSNet. We firstly introduce an intra-view aggregation module to adaptively extract image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zizhuang Wei , Qingtian Zhu , Chen Min , Yisong Chen , Guoping Wang

Recent advancements in learning-based Multi-View Stereo (MVS) methods have prominently featured transformer-based models with attention mechanisms. However, existing approaches have not thoroughly investigated the profound influence of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenjie Cao , Xinlin Ren , Yanwei Fu

While deep learning has recently achieved great success on multi-view stereo (MVS), limited training data makes the trained model hard to be generalized to unseen scenarios. Compared with other computer vision tasks, it is rather difficult…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yao Yao , Zixin Luo , Shiwei Li , Jingyang Zhang , Yufan Ren , Lei Zhou , Tian Fang , Long Quan

Recently, patch deformation-based methods have demonstrated significant effectiveness in multi-view stereo due to their incorporation of deformable and expandable perception for reconstructing textureless areas. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Zhenlong Yuan , Dapeng Zhang , Zehao Li , Chengxuan Qian , Jianing Chen , Yinda Chen , Kehua Chen , Tianlu Mao , Zhaoxin Li , Hao Jiang , Zhaoqi Wang

Recently, learning-based multi-view stereo methods have achieved promising results. However, they all overlook the visibility difference among different views, which leads to an indiscriminate multi-view similarity definition and greatly…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Qingshan Xu , Wenbing Tao

In this work, we propose a novel approach to prioritize the depth map computation of multi-view stereo (MVS) to obtain compact 3D point clouds of high quality and completeness at low computational cost. Our prioritization approach operates…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Christian Mostegel , Friedrich Fraundorfer , Horst Bischof

We introduce a novel multi-view stereo (MVS) method that can simultaneously recover not just per-pixel depth but also surface normals, together with the reflectance of textureless, complex non-Lambertian surfaces captured under known but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Kohei Yamashita , Yuto Enyo , Shohei Nobuhara , Ko Nishino

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

In this paper we present ActiveStereoNet, the first deep learning solution for active stereo systems. Due to the lack of ground truth, our method is fully self-supervised, yet it produces precise depth with a subpixel precision of $1/30th$…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yinda Zhang , Sameh Khamis , Christoph Rhemann , Julien Valentin , Adarsh Kowdle , Vladimir Tankovich , Michael Schoenberg , Shahram Izadi , Thomas Funkhouser , Sean Fanello

Deep learning has made significant impacts on multi-view stereo systems. State-of-the-art approaches typically involve building a cost volume, followed by multiple 3D convolution operations to recover the input image's pixel-wise depth.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Zhenpei Yang , Zhile Ren , Qi Shan , Qixing Huang

Multi-view stereopsis (MVS) tries to recover the 3D model from 2D images. As the observations become sparser, the significant 3D information loss makes the MVS problem more challenging. Instead of only focusing on densely sampled…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Mengqi Ji , Jinzhi Zhang , Qionghai Dai , Lu Fang

Deep Neural Networks (DNNs) have the potential to improve the quality of image-based 3D reconstructions. However, the use of DNNs in the context of 3D reconstruction from large and high-resolution image datasets is still an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Andreas Kuhn , Christian Sormann , Mattia Rossi , Oliver Erdler , Friedrich Fraundorfer

To obtain high-resolution depth maps, some previous learning-based multi-view stereo methods build a cost volume pyramid in a coarse-to-fine manner. These approaches leverage fixed depth range hypotheses to construct cascaded plane sweep…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Puyuan Yi , Shengkun Tang , Jian Yao

Surface reconstruction has traditionally relied on the Multi-View Stereo (MVS)-based pipeline, which often suffers from noisy and incomplete geometry. This is due to that although MVS has been proven to be an effective way to recover the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Wanjuan Su , Chen Zhang , Qingshan Xu , Wenbing Tao