English
Related papers

Related papers: Self-Supervised Learning of Depth and Camera Motio…

200 papers

Predicting accurate depth with monocular images is important for low-cost robotic applications and autonomous driving. This study proposes a comprehensive self-supervised framework for accurate scale-aware depth prediction on autonomous…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Yuxuan Liu , Zhenhua Xu , Huaiyang Huang , Lujia Wang , Ming Liu

We introduce a convolutional neural network model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. Panoramic depth estimation is an important technology for applications such as virtual reality, 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Alisha Sharma , Jonathan Ventura

Standard video encoders developed for conventional narrow field-of-view video are widely applied to 360{\deg} video as well, with reasonable results. However, while this approach commits arbitrarily to a projection of the spherical frames,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Yu-Chuan Su , Kristen Grauman

A well-known challenge in applying deep-learning methods to omnidirectional images is spherical distortion. In dense regression tasks such as depth estimation, where structural details are required, using a vanilla CNN layer on the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuyan Li , Yuliang Guo , Zhixin Yan , Xinyu Huang , Ye Duan , Liu Ren

Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Chao Fan , Zhenyu Yin , Yue Li , Feiqing Zhang

Single-view depth estimation from omnidirectional images has gained popularity with its wide range of applications such as autonomous driving and scene reconstruction. Although data-driven learning-based methods demonstrate significant…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Qi Feng , Hubert P. H. Shum , Shigeo Morishima

Accurate distance estimation is a fundamental challenge in robotic perception, particularly in omnidirectional imaging, where traditional geometric methods struggle with lens distortions and environmental variability. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Yitong Quan , Benjamin Kiefer , Martin Messmer , Andreas Zell

While 360{\deg} cameras offer tremendous new possibilities in vision, graphics, and augmented reality, the spherical images they produce make core feature extraction non-trivial. Convolutional neural networks (CNNs) trained on images from…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yu-Chuan Su , Kristen Grauman

Omnidirectional image and video super-resolution is a crucial research topic in low-level vision, playing an essential role in virtual reality and augmented reality applications. Its goal is to reconstruct high-resolution images or video…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qianqian Zhao , Chunle Guo , Tianyi Zhang , Junpei Zhang , Peiyang Jia , Tan Su , Wenjie Jiang , Chongyi Li

We present a novel approach for unsupervised learning of depth and ego-motion from monocular video. Unsupervised learning removes the need for separate supervisory signals (depth or ego-motion ground truth, or multi-view video). Prior work…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Reza Mahjourian , Martin Wicke , Anelia Angelova

Recent automotive vision work has focused almost exclusively on processing forward-facing cameras. However, future autonomous vehicles will not be viable without a more comprehensive surround sensing, akin to a human driver, as can be…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Grégoire Payen de La Garanderie , Amir Atapour Abarghouei , Toby P. Breckon

Monocular depth estimation has been actively studied in fields such as robot vision, autonomous driving, and 3D scene understanding. Given a sequence of color images, unsupervised learning methods based on the framework of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Songlin Wei , Guodong Chen , Wenzheng Chi , Zhenhua Wang , Lining Sun

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

A 360{\deg} perception of scene geometry is essential for automated driving, notably for parking and urban driving scenarios. Typically, it is achieved using surround-view fisheye cameras, focusing on the near-field area around the vehicle.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Varun Ravi Kumar , Marvin Klingner , Senthil Yogamani , Markus Bach , Stefan Milz , Tim Fingscheidt , Patrick Mäder

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estimation require…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Mertalp Ocal , Armin Mustafa

We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly to prior work, our…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Ariel Gordon , Hanhan Li , Rico Jonschkowski , Anelia Angelova

Self-supervised monocular depth estimation has shown impressive results in static scenes. It relies on the multi-view consistency assumption for training networks, however, that is violated in dynamic object regions and occlusions.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Libo Sun , Jia-Wang Bian , Huangying Zhan , Wei Yin , Ian Reid , Chunhua Shen

Learning to predict scene depth from RGB inputs is a challenging task both for indoor and outdoor robot navigation. In this work we address unsupervised learning of scene depth and robot ego-motion where supervision is provided by monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

360{\deg} cameras can capture complete environments in a single shot, which makes 360{\deg} imagery alluring in many computer vision tasks. However, monocular depth estimation remains a challenge for 360{\deg} data, particularly for high…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Manuel Rey-Area , Mingze Yuan , Christian Richardt

Self-supervised learning has emerged as a powerful tool for depth and ego-motion estimation, leading to state-of-the-art results on benchmark datasets. However, one significant limitation shared by current methods is the assumption of a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Sudeep Pillai , Wolfram Burgard , Greg Shakhnarovich , Adrien Gaidon