English
Related papers

Related papers: Multi view stereo with semantic priors

200 papers

Modern optical satellite sensors enable high-resolution stereo reconstruction from space. But the challenging imaging conditions when observing the Earth from space push stereo matching to its limits. In practice, the resulting digital…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Corinne Stucker , Konrad Schindler

We present a real-time visual-inertial dense mapping method capable of performing incremental 3D mesh reconstruction with high quality using only sequential monocular images and inertial measurement unit (IMU) readings. 6-DoF camera poses…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yingye Xin , Xingxing Zuo , Dongyue Lu , Stefan Leutenegger

Dense 3D visual mapping estimates as many as possible pixel depths, for each image. This results in very dense point clouds that often contain redundant and noisy information, especially for surfaces that are roughly planar, for instance,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Luca Morreale , Andrea Romanoni , Matteo Matteucci

Multi-task approaches to joint depth and segmentation prediction are well-studied for monocular images. Yet, predictions from a single-view are inherently limited, while multiple views are available in many robotics applications. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Mykhailo Shvets , Dongxu Zhao , Marc Niethammer , Roni Sengupta , Alexander C. Berg

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

Deep multi-view stereo (MVS) methods have been developed and extensively compared on simple datasets, where they now outperform classical approaches. In this paper, we ask whether the conclusions reached in controlled scenarios are still…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

Scene understanding is paramount in robotics, self-navigation, augmented reality, and many other fields. To fully accomplish this task, an autonomous agent has to infer the 3D structure of the sensed scene (to know where it looks at) and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Pier Luigi Dovesi , Matteo Poggi , Lorenzo Andraghetti , Miquel Martí , Hedvig Kjellström , Alessandro Pieropan , Stefano Mattoccia

PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is the first method…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Jinyu Zhao , Jumpei Oishi , Yusuke Monno , Masatoshi Okutomi

Highly accurate 3D volumetric reconstruction is still an open research topic where the main difficulty is usually related to merging some rough estimations with high frequency details. One of the most promising methods is the fusion between…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Fotios Logothetis , Roberto Mecca , Roberto Cipolla

Large language and vision models have been leading a revolution in visual computing. By greatly scaling up sizes of data and model parameters, the large models learn deep priors which lead to remarkable performance in various tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Junsheng Zhou , Yu-Shen Liu , Zhizhong Han

n this paper, we propose an effective and efficient pyramid multi-view stereo (MVS) net with self-adaptive view aggregation for accurate and complete dense point cloud reconstruction. Different from using mean square variance to generate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Hongwei Yi , Zizhuang Wei , Mingyu Ding , Runze Zhang , Yisong Chen , Guoping Wang , Yu-Wing Tai

We present a modern solution to the multi-view photometric stereo problem (MVPS). Our work suitably exploits the image formation model in a MVPS experimental setup to recover the dense 3D reconstruction of an object from images. We procure…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Berk Kaya , Suryansh Kumar , Francesco Sarno , Vittorio Ferrari , Luc Van Gool

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan

Mesh refinement is a fundamental step for accurate Multi-View Stereo. It modifies the geometry of an initial manifold mesh to minimize the photometric error induced in a set of camera pairs. This initial mesh is usually the output of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Andrea Romanoni , Matteo Matteucci

Stereo vision is essential for many applications. Currently, the synchronization of the streams coming from two cameras is done using mostly hardware. A software-based synchronization method would reduce the cost, weight and size of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Nicolas Boizard , Kevin El Haddad , Thierry Ravet , François Cresson , Thierry Dutoit

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yifei Shi , Junhua Xi , Dewen Hu , Zhiping Cai , Kai Xu

Multi-view stereo methods have achieved great success for depth estimation based on the coarse-to-fine depth learning frameworks, however, the existing methods perform poorly in recovering the depth of object boundaries and detail regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haitao Tian , Junyang Li , Chenxing Wang , Helong Jiang

Stereo matching is one of the widely used techniques for inferring depth from stereo images owing to its robustness and speed. It has become one of the major topics of research since it finds its applications in autonomous driving, robotic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Viny Saajan Victor , Peter Neigel

Recent studies have witnessed that self-supervised methods based on view synthesis obtain clear progress on multi-view stereo (MVS). However, existing methods rely on the assumption that the corresponding points among different views share…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hongbin Xu , Zhipeng Zhou , Yu Qiao , Wenxiong Kang , Qiuxia Wu

Multi-View Stereo plays a pivotal role in civil engineering by facilitating 3D modeling, precise engineering surveying, quantitative analysis, as well as monitoring and maintenance. It serves as a valuable tool, offering high-precision and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Hongxin Peng , Yongjian Liao , Weijun Li , Chuanyu Fu , Guoxin Zhang , Ziquan Ding , Zijie Huang , Qiku Cao , Shuting Cai