English
Related papers

Related papers: OmniMVS: End-to-End Learning for Omnidirectional S…

200 papers

We describe the design and 3D sensing performance of an omnidirectional stereo-vision system (omnistereo) as applied to Micro Aerial Vehicles (MAVs). The proposed omnistereo model employs a monocular camera that is co-axially aligned with a…

Computer Vision and Pattern Recognition · Computer Science 2016-02-09 Carlos Jaramillo

We propose a learning-based network for depth map estimation from multi-view stereo (MVS) images. Our proposed network consists of three sub-networks: 1) a base network for initial depth map estimation from an unstructured stereo image…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sizhang Dai , Weibing Huang

Omnidirectional image and video super-resolution is a crucial research topic in low-level vision, playing an essential role in virtual reality and augmented reality applications. Its goal is to reconstruct high-resolution images or video…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qianqian Zhao , Chunle Guo , Tianyi Zhang , Junpei Zhang , Peiyang Jia , Tan Su , Wenjie Jiang , Chongyi Li

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yao Yao , Zixin Luo , Shiwei Li , Tian Fang , Long Quan

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

We present a real-time visual-inertial dense mapping method capable of performing incremental 3D mesh reconstruction with high quality using only sequential monocular images and inertial measurement unit (IMU) readings. 6-DoF camera poses…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yingye Xin , Xingxing Zuo , Dongyue Lu , Stefan Leutenegger

In this paper, we introduce a deep multi-view stereo (MVS) system that jointly predicts depths, surface normals and per-view confidence maps. The key to our approach is a novel solver that iteratively solves for per-view depth map and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Wang Zhao , Shaohui Liu , Yi Wei , Hengkai Guo , Yong-Jin Liu

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Junhua Xi , Yifei Shi , Yijie Wang , Yulan Guo , Kai Xu

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

Computing accurate depth from multiple views is a fundamental and longstanding challenge in computer vision. However, most existing approaches do not generalize well across different domains and scene types (e.g. indoor vs. outdoor).…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Sergio Izquierdo , Mohamed Sayed , Michael Firman , Guillermo Garcia-Hernando , Daniyar Turmukhambetov , Javier Civera , Oisin Mac Aodha , Gabriel Brostow , Jamie Watson

Omnidirectional 3D information is essential for a wide range of applications such as Virtual Reality, Autonomous Driving, Robotics, etc. In this paper, we propose a novel, model-agnostic, two-stage pipeline for omnidirectional monocular…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yuyan Li , Zhixin Yan , Ye Duan , Liu Ren

We propose a novel approach for deep learning-based Multi-View Stereo (MVS). For each pixel in the reference image, our method leverages a deep architecture to search for the corresponding point in the source image directly along the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Christian Sormann , Emanuele Santellani , Mattia Rossi , Andreas Kuhn , Friedrich Fraundorfer

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xinyi Ye , Weiyue Zhao , Tianqi Liu , Zihao Huang , Zhiguo Cao , Xin Li

Recent work on depth estimation up to now has only focused on projective images ignoring 360 content which is now increasingly and more easily produced. We show that monocular depth estimation models trained on traditional images produce…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nikolaos Zioulis , Antonis Karakottas , Dimitrios Zarpalas , Petros Daras

In this work, we exploit a depth estimation Fully Convolutional Residual Neural Network (FCRN) for in-air perspective images to estimate the depth of underwater perspective and omni-directional images. We train one conventional and one…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Haofei Kuang , Qingwen Xu , Sören Schwertfeger

We propose a learning-based method that solves monocular stereo and can be extended to fuse depth information from multiple target frames. Given two unconstrained images from a monocular camera with known intrinsic calibration, our network…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Kaixuan Wang , Shaojie Shen

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yifei Shi , Junhua Xi , Dewen Hu , Zhiping Cai , Kai Xu

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Decai Chen , Markus Worchel , Ingo Feldmann , Oliver Schreer , Peter Eisert

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D search problem within a valid depth range. Recent deep learning-based MVS methods typically densely sample depth hypotheses in the depth range, and then construct…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhenxing Mi , Di Chang , Dan Xu