English
Related papers

Related papers: Towards Continual, Online, Self-Supervised Depth

200 papers

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu

Deep convolutional neural networks trained end-to-end are the state-of-the-art methods to regress dense disparity maps from stereo pairs. These models, however, suffer from a notable decrease in accuracy when exposed to scenarios…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Alessio Tonioni , Fabio Tosi , Matteo Poggi , Stefano Mattoccia , Luigi Di Stefano

Purpose: We propose a novel method for continual learning based on the increasing depth of neural networks. This work explores whether extending neural network depth may be beneficial in a life-long learning setting. Methods: We propose a…

Machine Learning · Computer Science 2023-05-09 Jędrzej Kozal , Michał Woźniak

Scene depth estimation from stereo and monocular imagery is critical for extracting 3D information for downstream tasks such as scene understanding. Recently, learning-based methods for depth estimation have received much attention due to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhaoshuo Li , Nathan Drenkow , Hao Ding , Andy S. Ding , Alexander Lu , Francis X. Creighton , Russell H. Taylor , Mathias Unberath

The dense depth estimation of a 3D scene has numerous applications, mainly in robotics and surveillance. LiDAR and radar sensors are the hardware solution for real-time depth estimation, but these sensors produce sparse depth maps and are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Alwyn Mathew , Aditya Prakash Patra , Jimson Mathew

In online continual learning, a neural network incrementally learns from a non-i.i.d. data stream. Nearly all online continual learning methods employ experience replay to simultaneously prevent catastrophic forgetting and underfitting on…

Machine Learning · Computer Science 2024-07-22 Jason Yoo , Yunpeng Liu , Frank Wood , Geoff Pleiss

We present ProtoDepth, a novel prototype-based approach for continual learning of unsupervised depth completion, the multimodal 3D reconstruction task of predicting dense depth maps from RGB images and sparse point clouds. The unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Patrick Rim , Hyoungseob Park , S. Gangopadhyay , Ziyao Zeng , Younjoon Chung , Alex Wong

Robotic surgery has become a powerful tool for performing minimally invasive procedures, providing advantages in dexterity, precision, and 3D vision, over traditional surgery. One popular robotic system is the da Vinci surgical platform,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Menglong Ye , Edward Johns , Ankur Handa , Lin Zhang , Philip Pratt , Guang-Zhong Yang

Despite learning-based visual odometry (VO) has shown impressive results in recent years, the pretrained networks may easily collapse in unseen environments. The large domain gap between training and testing data makes them difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shunkai Li , Xin Wu , Yingdian Cao , Hongbin Zha

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data. In this paper, we address the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tianwei Shen , Lei Zhou , Zixin Luo , Yao Yao , Shiwei Li , Jiahui Zhang , Tian Fang , Long Quan

As deep neural networks are increasingly deployed in dynamic, real-world environments, relying on a single static model is often insufficient. Changes in input data distributions caused by sensor drift or lighting variations necessitate…

Machine Learning · Computer Science 2025-09-26 Matteo Cardoni , Sam Leroux

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Jianrong Wang , Ge Zhang , Zhenyu Wu , XueWei Li , Li Liu

State-of-the-art approaches to infer dense depth measurements from images rely on CNNs trained end-to-end on a vast amount of data. However, these approaches suffer a drastic drop in accuracy when dealing with environments much different in…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Alessio Tonioni , Matteo Poggi , Stefano Mattoccia , Luigi Di Stefano

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn

Unsupervised methods have showed promising results on monocular depth estimation. However, the training data must be captured in scenes without moving objects. To push the envelope of accuracy, recent methods tend to increase their model…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Tak-Wai Hui

Single-View depth estimation using the CNNs trained from unlabelled videos has shown significant promise. However, excellent results have mostly been obtained in street-scene driving scenarios, and such methods often fail in other settings,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Jia-Wang Bian , Huangying Zhan , Naiyan Wang , Tat-Jun Chin , Chunhua Shen , Ian Reid

Unsupervised learning based depth estimation methods have received more and more attention as they do not need vast quantities of densely labeled data for training which are touch to acquire. In this paper, we propose a novel unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Lingtao Zhou , Jiaojiao Fang , Guizhong Liu

Previous methods on estimating detailed human depth often require supervised training with `ground truth' depth data. This paper presents a self-supervised method that can be trained on YouTube videos without known depth, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Feitong Tan , Hao Zhu , Zhaopeng Cui , Siyu Zhu , Marc Pollefeys , Ping Tan

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

In latest years, deep learning has gained a leading role in the pansharpening of multiresolution images. Given the lack of ground truth data, most deep learning-based methods carry out supervised training in a reduced-resolution domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Matteo Ciotola , Giovanni Poggi , Giuseppe Scarpa