English
Related papers

Related papers: SPIdepth: Strengthened Pose Information for Self-s…

200 papers

Self-supervised monocular depth estimation (DE) is an approach to learning depth without costly depth ground truths. However, it often struggles with moving objects that violate the static scene assumption during training. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jaeho Moon , Juan Luis Gonzalez Bello , Byeongjun Kwon , Munchurl Kim

Monocular depth estimation has been extensively explored based on deep learning, yet its accuracy and generalization ability still lag far behind the stereo-based methods. To tackle this, a few recent studies have proposed to supervise the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Kyeongseob Song , Kuk-Jin Yoon

Depth information is important for autonomous systems to perceive environments and estimate their own state. Traditional depth estimation methods, like structure from motion and stereo vision matching, are built on feature correspondences…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Chaoqiang Zhao , Qiyu Sun , Chongzhen Zhang , Yang Tang , Feng Qian

Detecting objects such as cars and pedestrians in 3D plays an indispensable role in autonomous driving. Existing approaches largely rely on expensive LiDAR sensors for accurate depth information. While recently pseudo-LiDAR has been…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yurong You , Yan Wang , Wei-Lun Chao , Divyansh Garg , Geoff Pleiss , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

Depth estimation from a stereo image pair has become one of the most explored applications in computer vision, with most of the previous methods relying on fully supervised learning settings. However, due to the difficulty in acquiring…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Baoru Huang , Jian-Qing Zheng , Stamatia Giannarou , Daniel S. Elson

In the recent years, many methods demonstrated the ability of neural networks to learn depth and pose changes in a sequence of images, using only self-supervision as the training signal. Whilst the networks achieve good performance, the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Robert McCraith , Lukas Neumann , Andrea Vedaldi

In the absence of parallax cues, a learning-based single image depth estimation (SIDE) model relies heavily on shading and contextual cues in the image. While this simplicity is attractive, it is necessary to train such models on large and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Suraj Patni , Aradhye Agarwal , Chetan Arora

We propose SUB-Depth, a universal multi-task training framework for self-supervised monocular depth estimation (SDE). Depth models trained with SUB-Depth outperform the same models trained in a standard single-task SDE framework. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Hang Zhou , Sarah Taylor , David Greenwood , Michal Mackiewicz

Existing self-supervised monocular depth estimation methods can get rid of expensive annotations and achieve promising results. However, these methods suffer from severe performance degradation when directly adopting a model trained on a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Mu He , Le Hui , Yikai Bian , Jian Ren , Jin Xie , Jian Yang

Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or structure from motion),…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Pierluigi Zama Ramirez , Matteo Poggi , Fabio Tosi , Stefano Mattoccia , Luigi Di Stefano

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler

As an inherently ill-posed problem, depth estimation from single images is the most challenging part of monocular 3D object detection (M3OD). Many existing methods rely on preconceived assumptions to bridge the missing spatial information…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Zhuoling Li , Zhan Qu , Yang Zhou , Jianzhuang Liu , Haoqian Wang , Lihui Jiang

Learning accurate depth is essential to multi-view 3D object detection. Recent approaches mainly learn depth from monocular images, which confront inherent difficulties due to the ill-posed nature of monocular depth learning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zengran Wang , Chen Min , Zheng Ge , Yinhao Li , Zeming Li , Hongyu Yang , Di Huang

Predicting pedestrian trajectories is essential for autonomous driving systems, as it significantly enhances safety and supports informed decision-making. Accurate predictions enable the prevention of collisions, anticipation of crossing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Akshat Ghiya , Ali K. AlShami , Jugal Kalita

Self-supervised depth estimation has drawn much attention in recent years as it does not require labeled data but image sequences. Moreover, it can be conveniently used in various applications, such as autonomous driving, robotics,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Shaocheng Jia , Xin Pei , Wei Yao , S. C. Wong

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Self-supervised multi-frame monocular depth estimation relies on the geometric consistency between successive frames under the assumption of a static scene. However, the presence of moving objects in dynamic scenes introduces inevitable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Sungmin Woo , Wonjoon Lee , Woo Jin Kim , Dogyoon Lee , Sangyoun Lee

Due to the rise of spherical cameras, monocular 360 depth estimation becomes an important technique for many applications (e.g., autonomous systems). Thus, state-of-the-art frameworks for monocular 360 depth estimation such as bi-projection…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Fu-En Wang , Yu-Hsuan Yeh , Yi-Hsuan Tsai , Wei-Chen Chiu , Min Sun

Over the past few years, self-supervised monocular depth estimation that does not depend on ground-truth during the training phase has received widespread attention. Most efforts focus on designing different types of network architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Shuwei Shao , Zhongcai Pei , Weihai Chen , Dingchi Sun , Peter C. Y. Chen , Zhengguo Li