English
Related papers

Related papers: Distilled Semantics for Comprehensive Scene Unders…

200 papers

Learning to predict scene depth from RGB inputs is a challenging task both for indoor and outdoor robot navigation. In this work we address unsupervised learning of scene depth and robot ego-motion where supervision is provided by monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Nowadays, the majority of state of the art monocular depth estimation techniques are based on supervised deep learning models. However, collecting RGB images with associated depth maps is a very time consuming procedure. Therefore, recent…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Andrea Pilzer , Stéphane Lathuilière , Nicu Sebe , Elisa Ricci

We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dipan Mandal , Abhilash Jain

Autonomous vehicles and robots require a full scene understanding of the environment to interact with it. Such a perception typically incorporates pixel-wise knowledge of the depths and semantic labels for each image from a video sensor.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Matthias Ochs , Adrian Kretz , Rudolf Mester

In this paper, we propose a novel method, X-Distill, to improve the self-supervised training of monocular depth via cross-task knowledge distillation from semantic segmentation to depth estimation. More specifically, during training, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Hong Cai , Janarbek Matai , Shubhankar Borse , Yizhe Zhang , Amin Ansari , Fatih Porikli

3D semantic scene understanding is a fundamental challenge in computer vision. It enables mobile agents to autonomously plan and navigate arbitrary environments. SSC formalizes this challenge as jointly estimating dense geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Adrian Hayler , Felix Wimbauer , Dominik Muhle , Christian Rupprecht , Daniel Cremers

Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or structure from motion),…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Pierluigi Zama Ramirez , Matteo Poggi , Fabio Tosi , Stefano Mattoccia , Luigi Di Stefano

Traditionally, training neural networks to perform semantic segmentation required expensive human-made annotations. But more recently, advances in the field of unsupervised learning have made significant progress on this issue and towards…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski

Monocular depth estimation has been extensively explored based on deep learning, yet its accuracy and generalization ability still lag far behind the stereo-based methods. To tackle this, a few recent studies have proposed to supervise the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Kyeongseob Song , Kuk-Jin Yoon

Robust three-dimensional scene understanding is now an ever-growing area of research highly relevant in many real-world applications such as autonomous driving and robotic navigation. In this paper, we propose a multi-task learning-based…

Computer Vision and Pattern Recognition · Computer Science 2019-08-16 Amir Atapour-Abarghouei , Toby P. Breckon

A single color image can contain many cues informative towards different aspects of local geometric structure. We approach the problem of monocular depth estimation by using a neural network to produce a mid-level representation that…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Ayan Chakrabarti , Jingyu Shao , Gregory Shakhnarovich

While deep neural networks have led to human-level performance on computer vision tasks, they have yet to demonstrate similar gains for holistic scene understanding. In particular, 3D context has been shown to be an extremely important cue…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Yinda Zhang , Mingru Bai , Pushmeet Kohli , Shahram Izadi , Jianxiong Xiao

We present a novel method to train machine learning algorithms to estimate scene depths from a single image, by using the information provided by a camera's aperture as supervision. Prior works use a depth sensor's outputs or images of the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Pratul P. Srinivasan , Rahul Garg , Neal Wadhwa , Ren Ng , Jonathan T. Barron

Monocular depth estimation aims at estimating a pixelwise depth map for a single image, which has wide applications in scene understanding and autonomous driving. Existing supervised and unsupervised methods face great challenges.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Xiaoyang Guo , Hongsheng Li , Shuai Yi , Jimmy Ren , Xiaogang Wang

We study data-free knowledge distillation (KD) for monocular depth estimation (MDE), which learns a lightweight model for real-world depth perception tasks by compressing it from a trained teacher model while lacking training data in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Junjie Hu , Chenyou Fan , Mete Ozay , Hualie Jiang , Tin Lun Lam

Depth estimation provides essential information to perform autonomous driving and driver assistance. Especially, Monocular Depth Estimation is interesting from a practical point of view, since using a single camera is cheaper than many…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Akhil Gurram , Onay Urfalioglu , Ibrahim Halfaoui , Fahd Bouzaraa , Antonio M. Lopez

Robust geometric and semantic scene understanding is ever more important in many real-world applications such as autonomous driving and robotic navigation. In this paper, we propose a multi-task learning-based approach capable of jointly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-22 Amir Atapour-Abarghouei , Toby P. Breckon

In this paper, we tackle the problem of estimating the depth of a scene from a monocular video sequence. In particular, we handle challenging scenarios, such as non-translational camera motion and dynamic scenes, where traditional structure…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Miaomiao Liu , Mathieu Salzmann , Xuming He

Scene depth estimation from stereo and monocular imagery is critical for extracting 3D information for downstream tasks such as scene understanding. Recently, learning-based methods for depth estimation have received much attention due to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhaoshuo Li , Nathan Drenkow , Hao Ding , Andy S. Ding , Alexander Lu , Francis X. Creighton , Russell H. Taylor , Mathias Unberath

Self-supervised monocular depth estimation has been widely investigated to estimate depth images and relative poses from RGB images. This framework is attractive for researchers because the depth and pose networks can be trained from just…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Noriaki Hirose , Kosuke Tahara