English
Related papers

Related papers: Self-supervised Learning for Single View Depth and…

200 papers

We study how autonomous robots can learn by themselves to improve their depth estimation capability. In particular, we investigate a self-supervised learning setup in which stereo vision depth estimates serve as targets for a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Diogo Martins , Kevin van Hecke , Guido de Croon

Obtaining accurate depth measurements out of a single image represents a fascinating solution to 3D sensing. CNNs led to considerable improvements in this field, and recent trends replaced the need for ground-truth labels with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Matteo Poggi , Fabio Tosi , Stefano Mattoccia

We present a method for jointly predicting a depth map and intrinsic images from single-image input. The two tasks are formulated in a synergistic manner through a joint conditional random field (CRF) that is solved using a novel…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Seungryong Kim , Kihong Park , Kwanghoon Sohn , Stephen Lin

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

Machine Learning · Computer Science 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Self-supervised monocular depth estimation is an attractive solution that does not require hard-to-source depth labels for training. Convolutional neural networks (CNNs) have recently achieved great success in this task. However, their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Chaoqiang Zhao , Youmin Zhang , Matteo Poggi , Fabio Tosi , Xianda Guo , Zheng Zhu , Guan Huang , Yang Tang , Stefano Mattoccia

Supervised learning methods to infer (hypothesize) depth of a scene from a single image require costly per-pixel ground-truth. We follow a geometric approach that exploits abundant stereo imagery to learn a model to hypothesize scene…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Alex Wong , Byung-Woo Hong , Stefano Soatto

A unified self-supervised and supervised deep learning framework for PET image reconstruction is presented, including deep-learned filtered backprojection (DL-FBP) for sinograms, deep-learned backproject then filter (DL-BPF) for…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Andrew J. Reader

We introduce an approach that leverages surface normal predictions, along with appearance cues, to retrieve 3D models for objects depicted in 2D still images from a large CAD object library. Critical to the success of our approach is the…

Computer Vision and Pattern Recognition · Computer Science 2016-04-06 Aayush Bansal , Bryan Russell , Abhinav Gupta

Depth estimation provides essential information to perform autonomous driving and driver assistance. Especially, Monocular Depth Estimation is interesting from a practical point of view, since using a single camera is cheaper than many…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Akhil Gurram , Onay Urfalioglu , Ibrahim Halfaoui , Fahd Bouzaraa , Antonio M. Lopez

It is a classical compute vision problem to obtain real scene depth maps by using a monocular camera, which has been widely concerned in recent years. However, training this model usually requires a large number of artificially labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang

Automated surface segmentation is important and challenging in many medical image analysis applications. Recent deep learning based methods have been developed for various object segmentation tasks. Most of them are a classification based…

Image and Video Processing · Electrical Eng. & Systems 2020-07-03 Leixin Zhou , Xiaodong Wu

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi

Recent techniques in self-supervised monocular depth estimation are approaching the performance of supervised methods, but operate in low resolution only. We show that high resolution is key towards high-fidelity self-supervised monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Sudeep Pillai , Rares Ambrus , Adrien Gaidon

Robotic surgery has become a powerful tool for performing minimally invasive procedures, providing advantages in dexterity, precision, and 3D vision, over traditional surgery. One popular robotic system is the da Vinci surgical platform,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Menglong Ye , Edward Johns , Ankur Handa , Lin Zhang , Philip Pratt , Guang-Zhong Yang

Recent advances in end-to-end unsupervised learning has significantly improved the performance of monocular depth prediction and alleviated the requirement of ground truth depth. Although a plethora of work has been done in enforcing…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Vinay Kaushik , Brejesh Lall

Monocular 3D object parsing is highly desirable in various scenarios including occlusion reasoning and holistic scene interpretation. We present a deep convolutional neural network (CNN) architecture to localize semantic parts in 2D image…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Chi Li , M. Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Gregory D. Hager , Manmohan Chandraker

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim