English
Related papers

Related papers: Multiview Stereo with Cascaded Epipolar RAFT

200 papers

We introduce RAFT-Stereo, a new deep architecture for rectified stereo based on the optical flow network RAFT. We introduce multi-level convolutional GRUs, which more efficiently propagate information across the image. A modified version of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Lahav Lipson , Zachary Teed , Jia Deng

Pairwise matching cost aggregation is a crucial step for modern learning-based Multi-view Stereo (MVS). Prior works adopt an early aggregation scheme, which adds up pairwise costs into an intermediate cost. However, we analyze that this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Jiang Wu , Rui Li , Yu Zhu , Wenxun Zhao , Jinqiu Sun , Yanning Zhang

GigaMVS presents several challenges to existing Multi-View Stereo (MVS) algorithms for its large scale, complex occlusions, and gigapixel images. To address these problems, we first apply one of the state-of-the-art learning-based MVS…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Chenjie Cao , Xinlin Ren , Xiangyang Xue , Yanwei Fu

Bounded by the inherent ambiguity of depth perception, contemporary camera-based 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Yinhao Li , Han Bao , Zheng Ge , Jinrong Yang , Jianjian Sun , Zeming Li

The biggest improvements in Photometric Stereo (PS) field has recently come from adoption of differentiable volumetric rendering techniques such as NeRF or Neural SDF achieving impressive reconstruction error of 0.2mm on DiLiGenT-MV…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Fotios Logothetis , Ignas Budvytis , Stephan Liwicki , Roberto Cipolla

Recent learning-based multi-view stereo (MVS) methods show excellent performance with dense cameras and small depth ranges. However, non-learning based approaches still outperform for scenes with large depth ranges and sparser wide-baseline…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Jae Yong Lee , Joseph DeGol , Chuhang Zou , Derek Hoiem

In this work, we propose a novel approach to prioritize the depth map computation of multi-view stereo (MVS) to obtain compact 3D point clouds of high quality and completeness at low computational cost. Our prioritization approach operates…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Christian Mostegel , Friedrich Fraundorfer , Horst Bischof

Stereo matching is a fundamental task in scene comprehension. In recent years, the method based on iterative optimization has shown promise in stereo matching. However, the current iteration framework employs a single-peak lookup, which…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Miaojie Feng , Junda Cheng , Hao Jia , Longliang Liu , Gangwei Xu , Qingyong Hu , Xin Yang

This paper proposes a network, referred to as MVSTR, for Multi-View Stereo (MVS). It is built upon Transformer and is capable of extracting dense features with global context and 3D consistency, which are crucial to achieving reliable…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jie Zhu , Bo Peng , Wanqing Li , Haifeng Shen , Zhe Zhang , Jianjun Lei

To reconstruct a 3D scene from a set of calibrated views, traditional multi-view stereo techniques rely on two distinct stages: local depth maps computation and global depth maps fusion. Recent studies concentrate on deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Jaesung Choe , Sunghoon Im , Francois Rameau , Minjun Kang , In So Kweon

Multi-task approaches to joint depth and segmentation prediction are well-studied for monocular images. Yet, predictions from a single-view are inherently limited, while multiple views are available in many robotics applications. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Mykhailo Shvets , Dongxu Zhao , Marc Niethammer , Roni Sengupta , Alexander C. Berg

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

Multi-view stereopsis (MVS) tries to recover the 3D model from 2D images. As the observations become sparser, the significant 3D information loss makes the MVS problem more challenging. Instead of only focusing on densely sampled…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Mengqi Ji , Jinzhi Zhang , Qionghai Dai , Lu Fang

Deep multi-view stereo (MVS) methods have been developed and extensively compared on simple datasets, where they now outperform classical approaches. In this paper, we ask whether the conclusions reached in controlled scenarios are still…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

We propose an online multi-view depth prediction approach on posed video streams, where the scene geometry information computed in the previous time steps is propagated to the current time step in an efficient and geometrically plausible…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Arda Düzçeker , Silvano Galliani , Christoph Vogel , Pablo Speciale , Mihai Dusmanu , Marc Pollefeys

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D search problem within a valid depth range. Recent deep learning-based MVS methods typically densely sample depth hypotheses in the depth range, and then construct…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhenxing Mi , Di Chang , Dan Xu

With FaSS-MVS, we present an approach for fast multi-view stereo with surface-aware Semi-Global Matching that allows for rapid depth and normal map estimation from monocular aerial video data captured by UAVs. The data estimated by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Boitumelo Ruf , Martin Weinmann , Stefan Hinz

Research on multi-view stereo based on remote sensing images has promoted the development of large-scale urban 3D reconstruction. However, remote sensing multi-view image data suffers from the problems of occlusion and uneven brightness…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yong-Qiang Mao , Hanbo Bi , Liangyu Xu , Kaiqiang Chen , Zhirui Wang , Xian Sun , Kun Fu

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yao Yao , Zixin Luo , Shiwei Li , Tian Fang , Long Quan