English
Related papers

Related papers: D$^3$epth: Self-Supervised Depth Estimation with D…

200 papers

This paper presents a unified framework for depth-aware panoptic segmentation (DPS), which aims to reconstruct 3D scene with instance-level semantics from one single image. Prior works address this problem by simply adding a dense depth…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Naiyu Gao , Fei He , Jian Jia , Yanhu Shan , Haoyang Zhang , Xin Zhao , Kaiqi Huang

Conventional self-supervised monocular depth prediction methods are based on a static environment assumption, which leads to accuracy degradation in dynamic scenes due to the mismatch and occlusion problems introduced by object motions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ziyue Feng , Liang Yang , Longlong Jing , Haiyan Wang , YingLi Tian , Bing Li

Self-supervised depth estimation has evolved into an image reconstruction task that minimizes a photometric loss. While recent methods have made strides in indoor depth estimation, they often produce inconsistent depth estimation in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Anqi Cheng , Zhiyuan Yang , Haiyue Zhu , Kezhi Mao

Robotic-assisted surgery allows surgeons to conduct precise surgical operations with stereo vision and flexible motor control. However, the lack of 3D spatial perception limits situational awareness during procedures and hinders mastering…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Shang Zhao , Ce Wang , Qiyuan Wang , Yanzhe Liu , S Kevin Zhou

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Keyang Zhou , Kailun Yang , Kaiwei Wang

In this paper, we present a fast monocular depth estimation method for enabling 3D perception capabilities of low-cost underwater robots. We formulate a novel end-to-end deep visual learning pipeline named UDepth, which incorporates domain…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Boxiao Yu , Jiayi Wu , Md Jahidul Islam

We present a novel approach for estimating depth from a monocular camera as it moves through complex and crowded indoor environments, e.g., a department store or a metro station. Our approach predicts absolute scale depth maps over the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Dongki Jung , Jaehoon Choi , Yonghan Lee , Deokhwa Kim , Changick Kim , Dinesh Manocha , Donghwan Lee

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth estimation network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Nan Yang , Lukas von Stumberg , Rui Wang , Daniel Cremers

Scale-aware monocular depth estimation poses a significant challenge in computer-aided endoscopic navigation. However, existing depth estimation methods that do not consider the geometric priors struggle to learn the absolute scale from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Ruofeng Wei , Bin Li , Kai Chen , Yiyao Ma , Yunhui Liu , Qi Dou

Surround depth estimation provides a cost-effective alternative to LiDAR for 3D perception in autonomous driving. While recent self-supervised methods explore multi-camera settings to improve scale awareness and scene coverage, they are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Weimin Liu , Jiyuan Qiu , Wenjun Wang , Joshua H. Meng

In this study, we address the challenge of 3D scene structure recovery from monocular depth estimation. While traditional depth estimation methods leverage labeled datasets to directly predict absolute depth, recent advancements advocate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chi Zhang , Wei Yin , Gang Yu , Zhibin Wang , Tao Chen , Bin Fu , Joey Tianyi Zhou , Chunhua Shen

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

Depth estimation is a cornerstone of perception in autonomous driving and robotic systems. The considerable cost and relatively sparse data acquisition of LiDAR systems have led to the exploration of cost-effective alternatives, notably,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yucheng Mao , Ruowen Zhao , Tianbao Zhang , Hang Zhao

Single view depth estimation models can be trained from video footage using a self-supervised end-to-end approach with view synthesis as the supervisory signal. This is achieved with a framework that predicts depth and camera motion, with a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Maarten Schellevis

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

Depth sensing is an important problem for 3D vision-based robotics. Yet, a real-world active stereo or ToF depth camera often produces noisy and incomplete depth which bottlenecks robot performances. In this work, we propose D3RoMa, a…

We propose MaskingDepth, a novel semi-supervised learning framework for monocular depth estimation to mitigate the reliance on large ground-truth depth quantities. MaskingDepth is designed to enforce consistency between the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jongbeom Baek , Gyeongnyeon Kim , Seonghoon Park , Honggyu An , Matteo Poggi , Seungryong Kim

Self-supervised monocular depth estimation is of significant importance with applications spanning across autonomous driving and robotics. However, the reliance on self-supervision introduces a strong static-scene assumption, thereby posing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yue-Jiang Dong , Yuan-Chen Guo , Ying-Tian Liu , Fang-Lue Zhang , Song-Hai Zhang

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estimation require…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Mertalp Ocal , Armin Mustafa