English
Related papers

Related papers: Visibility-aware Multi-view Stereo Network

200 papers

With FaSS-MVS, we present an approach for fast multi-view stereo with surface-aware Semi-Global Matching that allows for rapid depth and normal map estimation from monocular aerial video data captured by UAVs. The data estimated by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Boitumelo Ruf , Martin Weinmann , Stefan Hinz

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan

We introduce Double Cost Volume Stereo Matching Network(DCVSMNet) which is a novel architecture characterised by by two small upper (group-wise) and lower (norm correlation) cost volumes. Each cost volume is processed separately, and a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Mahmoud Tahmasebi , Saif Huq , Kevin Meehan , Marion McAfee

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn

Multi-view stereo (MVS) is the golden mean between the accuracy of active depth sensing and the practicality of monocular depth estimation. Cost volume based approaches employing 3D convolutional neural networks (CNNs) have considerably…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Ayan Sinha , Zak Murez , James Bartolozzi , Vijay Badrinarayanan , Andrew Rabinovich

This study addresses the challenge of online 3D model generation for neural rendering using an RGB image stream. Previous research has tackled this issue by incorporating Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS) as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Byeonggwon Lee , Junkyu Park , Khang Truong Giang , Sungho Jo , Soohwan Song

Stereo matching estimates the disparity between a rectified image pair, which is of great importance to depth sensing, autonomous driving, and other related tasks. Previous works built cost volumes with cross-correlation or concatenation of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Xiaoyang Guo , Kai Yang , Wukui Yang , Xiaogang Wang , Hongsheng Li

Self-supervised monocular methods can efficiently learn depth information of weakly textured surfaces or reflective objects. However, the depth accuracy is limited due to the inherent ambiguity in monocular geometric modeling. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Xiaofeng Wang , Zheng Zhu , Guan Huang , Xu Chi , Yun Ye , Ziwei Chen , Xingang Wang

Learning-based multi-view stereo (MVS) method heavily relies on feature matching, which requires distinctive and descriptive representations. An effective solution is to apply non-local feature aggregation, e.g., Transformer. Albeit useful,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Tianqi Liu , Xinyi Ye , Weiyue Zhao , Zhiyu Pan , Min Shi , Zhiguo Cao

Despite stereo matching accuracy has greatly improved by deep learning in the last few years, recovering sharp boundaries and high-resolution outputs efficiently remains challenging. In this paper, we propose Stereo Mixture Density Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Fabio Tosi , Yiyi Liao , Carolin Schmitt , Andreas Geiger

In this paper, a complete pipeline for image-based 3D reconstruction of urban scenarios is proposed, based on PatchMatch Multi-View Stereo (MVS). Input images are firstly fed into an off-the-shelf visual SLAM system to extract camera poses…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

We present a modern solution to the multi-view photometric stereo problem (MVPS). Our work suitably exploits the image formation model in a MVPS experimental setup to recover the dense 3D reconstruction of an object from images. We procure…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Berk Kaya , Suryansh Kumar , Francesco Sarno , Vittorio Ferrari , Luc Van Gool

We present a real-time visual-inertial dense mapping method capable of performing incremental 3D mesh reconstruction with high quality using only sequential monocular images and inertial measurement unit (IMU) readings. 6-DoF camera poses…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yingye Xin , Xingxing Zuo , Dongyue Lu , Stefan Leutenegger

Multiview camera setups have proven useful in many computer vision applications for reducing ambiguities, mitigating occlusions, and increasing field-of-view coverage. However, the high computational cost associated with multiple views…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yunzhong Hou , Stephen Gould , Liang Zheng

Self-supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground-truth depth, online fine-tuning, and better generalization with unlimited data attract researchers to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Weihao Yuan , Yazhan Zhang , Bingkun Wu , Siyu Zhu , Ping Tan , Michael Yu Wang , Qifeng Chen

PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is the first method…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Jinyu Zhao , Jumpei Oishi , Yusuke Monno , Masatoshi Okutomi

Weighted twin support vector machines (WLTSVM) mines as much potential similarity information in samples as possible to improve the common short-coming of non-parallel plane classifiers. Compared with twin support vector machines (TWSVM),…

Machine Learning · Statistics 2022-01-28 Ruxin Xu , Huiru Wang

We study the effects of the additional input to deep multi-view stereo methods in the form of low-quality sensor depth. We modify two state-of-the-art deep multi-view stereo methods for using with the input depth. We show that the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Oleg Voynov , Aleksandr Safin , Savva Ignatyev , Evgeny Burnaev

Multi-view 3D object detection is a fundamental task in autonomous driving perception, where achieving a balance between detection accuracy and computational efficiency remains crucial. Sparse query-based 3D detectors efficiently aggregate…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Di Wu , Feng Yang , Wenhui Zhao , Jinwen Yu , Pan Liao , Benlian Xu , Dingwen Zhang

Multi-view stereo (MVS) models based on progressive depth hypothesis narrowing have made remarkable advancements. However, existing methods haven't fully utilized the potential that the depth coverage of individual instances is smaller than…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yinzhe Wang , Yiwen Xiao , Hu Wang , Yiping Xu , Yan Tian