English
Related papers

Related papers: Visibility-aware Multi-view Stereo Network

200 papers

Optical flow estimation is an essential step for many real-world computer vision tasks. Existing deep networks have achieved satisfactory results by mostly employing a pyramidal coarse-to-fine paradigm, where a key process is to adopt…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Lingtong Kong , Xiaohang Yang , Jie Yang

Disparity prediction from stereo images is essential to computer vision applications including autonomous driving, 3D model reconstruction, and object detection. To predict accurate disparity map, we propose a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Zhibo Rao , Mingyi He , Yuchao Dai , Zhidong Zhu , Bo Li , Renjie He

To obtain high-resolution depth maps, some previous learning-based multi-view stereo methods build a cost volume pyramid in a coarse-to-fine manner. These approaches leverage fixed depth range hypotheses to construct cascaded plane sweep…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Puyuan Yi , Shengkun Tang , Jian Yao

Estimating depth from RGB images is a long-standing ill-posed problem, which has been explored for decades by the computer vision, graphics, and machine learning communities. Among the existing techniques, stereo matching remains one of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Hamid Laga , Laurent Valentin Jospin , Farid Boussaid , Mohammed Bennamoun

Conventional training for optical flow and stereo depth models typically employs a uniform loss function across all pixels. However, this one-size-fits-all approach often overlooks the significant variations in learning difficulty among…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jisoo Jeong , Hong Cai , Jamie Menjay Lin , Fatih Porikli

We present MVSGaussian, a new generalizable 3D Gaussian representation approach derived from Multi-View Stereo (MVS) that can efficiently reconstruct unseen scenes. Specifically, 1) we leverage MVS to encode geometry-aware Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianqi Liu , Guangcong Wang , Shoukang Hu , Liao Shen , Xinyi Ye , Yuhang Zang , Zhiguo Cao , Wei Li , Ziwei Liu

Deep learning has recently demonstrated its excellent performance on the task of multi-view stereo (MVS). However, loss functions applied for deep MVS are rarely studied. In this paper, we first analyze existing loss functions' properties…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qinglu Min , Jie Zhao , Zhihao Zhang , Chen Min

Scene reconstruction from unorganized RGB images is an important task in many computer vision applications. Multi-view Stereo (MVS) is a common solution in photogrammetry applications for the dense reconstruction of a static scene. The…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Matthias Innmann , Kihwan Kim , Jinwei Gu , Matthias Niessner , Charles Loop , Marc Stamminger , Jan Kautz

We propose a system that uses a convolution neural network (CNN) to estimate depth from a stereo pair followed by volumetric fusion of the predicted depth maps to produce a 3D reconstruction of a scene. Our proposed depth refinement…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Rohan Chabra , Julian Straub , Chris Sweeney , Richard Newcombe , Henry Fuchs

3D terrain reconstruction with remote sensing imagery achieves cost-effective and large-scale earth observation and is crucial for safeguarding natural disasters, monitoring ecological changes, and preserving the environment.Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Song Zhang , Zhiwei Wei , Wenjia Xu , Lili Zhang , Yang Wang , Jinming Zhang , Junyi Liu

Recently, patch-deformation methods have exhibited significant effectiveness in multi-view stereo owing to the deformable and expandable patches in reconstructing textureless areas. However, such methods primarily emphasize broadening the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zhenlong Yuan , Zhidong Yang , Yujun Cai , Kuangxin Wu , Mufan Liu , Dapeng Zhang , Hao Jiang , Zhaoxin Li , Zhaoqi Wang

Self-supervised monocular depth estimation, aiming to learn scene depths from single images in a self-supervised manner, has received much attention recently. In spite of recent efforts in this field, how to learn accurate scene depths and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Zhengming Zhou , Qiulei Dong

We propose a learning-based method that solves monocular stereo and can be extended to fuse depth information from multiple target frames. Given two unconstrained images from a monocular camera with known intrinsic calibration, our network…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Kaixuan Wang , Shaojie Shen

In this paper, we present a novel recurrent multi-view stereo network based on long short-term memory (LSTM) with adaptive aggregation, namely AA-RMVSNet. We firstly introduce an intra-view aggregation module to adaptively extract image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zizhuang Wei , Qingtian Zhu , Chen Min , Yisong Chen , Guoping Wang

In this paper, we present TANDEM a real-time monocular tracking and dense mapping framework. For pose estimation, TANDEM performs photometric bundle adjustment based on a sliding window of keyframes. To increase the robustness, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Lukas Koestler , Nan Yang , Niclas Zeller , Daniel Cremers

End-to-end deep-learning networks recently demonstrated extremely good perfor- mance for stereo matching. However, existing networks are difficult to use for practical applications since (1) they are memory-hungry and unable to process even…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Stepan Tulyakov , Anton Ivanov , Francois Fleuret

At present, deep learning has been applied more and more in monocular image depth estimation and has shown promising results. The current more ideal method for monocular depth estimation is the supervised learning based on ground truth…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Zhimin Zhang , Jianzhong Qiao , Shukuan Lin

Obstacle detection is a safety-critical problem in robot navigation, where stereo matching is a popular vision-based approach. While deep neural networks have shown impressive results in computer vision, most of the previous obstacle…

Robotics · Computer Science 2023-03-07 Hongyu Li , Zhengang Li , Neset Unver Akmandor , Huaizu Jiang , Yanzhi Wang , Taskin Padir

Recent advancements in neural surface reconstruction have significantly enhanced 3D reconstruction. However, current real world datasets mainly focus on benchmarking multiview stereo (MVS) based on RGB inputs. Multiview photometric stereo…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zaiyan Yang , Jieji Ren , Xiangyi Wang , zonglin li , Xu Cao , Heng Guo , Zhanyu Ma , Boxin Shi

In this paper, we propose an efficient and effective dense hybrid recurrent multi-view stereo net with dynamic consistency checking, namely $D^{2}$HC-RMVSNet, for accurate dense point cloud reconstruction. Our novel hybrid recurrent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Jianfeng Yan , Zizhuang Wei , Hongwei Yi , Mingyu Ding , Runze Zhang , Yisong Chen , Guoping Wang , Yu-Wing Tai