English
Related papers

Related papers: MFuseNet: Robust Depth Estimation with Learned Mul…

200 papers

In this paper, we present a learning-based framework for sparse depth video completion. Given a sparse depth map and a color image at a certain viewpoint, our approach makes a cost volume that is constructed on depth hypothesis planes. To…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Jungeon Kim , Soongjin Kim , Jaesik Park , Seungyong Lee

Multi-frame methods improve monocular depth estimation over single-frame approaches by aggregating spatial-temporal information via feature matching. However, the spatial-temporal feature leads to accuracy degradation in dynamic scenes. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiquan Zhong , Xiaolin Huang , Xiao Yu

While the keypoint-based maps created by sparse monocular simultaneous localisation and mapping (SLAM) systems are useful for camera tracking, dense 3D reconstructions may be desired for many robotic tasks. Solutions involving depth cameras…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Tristan Laidlow , Jan Czarnowski , Stefan Leutenegger

Transparent object perception is indispensable for numerous robotic tasks. However, accurately segmenting and estimating the depth of transparent objects remain challenging due to complex optical properties. Existing methods primarily delve…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jiangyuan Liu , Hongxuan Ma , Yuxin Guo , Yuhao Zhao , Chi Zhang , Wei Sui , Wei Zou

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn

This paper introduces a novel deep framework for dense 3D reconstruction from multiple image frames, leveraging a sparse set of depth measurements gathered jointly with image acquisition. Given a deep multi-view stereo network, our…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Matteo Poggi , Andrea Conti , Stefano Mattoccia

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Yao Yao , Zixin Luo , Shiwei Li , Tian Fang , Long Quan

Monocular depth estimation is the task of obtaining a measure of distance for each pixel using a single image. It is an important problem in computer vision and is usually solved using neural networks. Though recent works in this area have…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Nikita Durasov , Mikhail Romanov , Valeriya Bubnova , Pavel Bogomolov , Anton Konushin

Depth Estimation and Object Detection Recognition play an important role in autonomous driving technology under the guidance of deep learning artificial intelligence. We propose a hybrid structure called RealNet: a co-design method…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Zhuohao Li , Fandi Gou , Qixin De , Leqi Ding , Yuanhang Zhang , Yunze Cai

Accurate depth estimation with lowest compute and energy cost is a crucial requirement for unmanned and battery operated autonomous systems. Robotic applications require real time depth estimation for navigation and decision making under…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Rajeev Patwari , Varo Ly

Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Rares Ambrus , Dian Chen , Sergey Zakharov , Adrien Gaidon

To reconstruct a 3D scene from a set of calibrated views, traditional multi-view stereo techniques rely on two distinct stages: local depth maps computation and global depth maps fusion. Recent studies concentrate on deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Jaesung Choe , Sunghoon Im , Francois Rameau , Minjun Kang , In So Kweon

We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dipan Mandal , Abhilash Jain

Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (HR) ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Jialei Xu , Yuanchao Bai , Xianming Liu , Junjun Jiang , Xiangyang Ji

Depth estimation from monocular endoscopic images presents significant challenges due to the complexity of endoscopic surgery, such as irregular shapes of human soft tissues, as well as variations in lighting conditions. Existing methods…

Image and Video Processing · Electrical Eng. & Systems 2025-02-07 Dawei Lu , Deqiang Xiao , Danni Ai , Jingfan Fan , Tianyu Fu , Yucong Lin , Hong Song , Xujiong Ye , Lei Zhang , Jian Yang

Event cameras are bio-inspired sensors that offer advantages over traditional cameras. They operate asynchronously, sampling the scene at microsecond resolution and producing a stream of brightness changes. This unconventional output has…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Suman Ghosh , Guillermo Gallego

Omnidirectional depth sensing has its advantage over the conventional stereo systems since it enables us to recognize the objects of interest in all directions without any blind regions. In this paper, we propose a novel wide-baseline…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Changhee Won , Jongbin Ryu , Jongwoo Lim

Learning-based multi-view stereo (MVS) methods have demonstrated promising results. However, very few existing networks explicitly take the pixel-wise visibility into consideration, resulting in erroneous cost aggregation from occluded…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jingyang Zhang , Yao Yao , Shiwei Li , Zixin Luo , Tian Fang

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

Depth from a monocular video can enable billions of devices and robots with a single camera to see the world in 3D. In this paper, we present an approach with a differentiable flow-to-depth layer for video depth estimation. The model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Jiaxin Xie , Chenyang Lei , Zhuwen Li , Li Erran Li , Qifeng Chen