English
Related papers

Related papers: Geometry-Based Next Frame Prediction from Monocula…

200 papers

Depth from a monocular video can enable billions of devices and robots with a single camera to see the world in 3D. In this paper, we present an approach with a differentiable flow-to-depth layer for video depth estimation. The model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Jiaxin Xie , Chenyang Lei , Zhuwen Li , Li Erran Li , Qifeng Chen

Estimating 3D scene flow from a sequence of monocular images has been gaining increased attention due to the simple, economical capture setup. Owing to the severe ill-posedness of the problem, the accuracy of current methods has been…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Junhwa Hur , Stefan Roth

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Jianrong Wang , Ge Zhang , Zhenyu Wu , XueWei Li , Li Liu

Although considerable advancements have been attained in self-supervised depth estimation from monocular videos, most existing methods often treat all objects in a video as static entities, which however violates the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xiuzhe Wu , Xiaoyang Lyu , Qihao Huang , Yong Liu , Yang Wu , Ying Shan , Xiaojuan Qi

Depth estimation is a challenging task of 3D reconstruction to enhance the accuracy sensing of environment awareness. This work brings a new solution with a set of improvements, which increase the quantitative and qualitative understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Armin Masoumian , Hatem A. Rashwan , Saddam Abdulwahab , Julian Cristiano , Domenec Puig

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

Estimating the 3D position and orientation of objects in the environment with a single RGB camera is a critical and challenging task for low-cost urban autonomous driving and mobile robots. Most of the existing algorithms are based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Yuxuan Liu , Yuan Yixuan , Ming Liu

Deep neural networks have lead to a breakthrough in depth estimation from single images. Recent work often focuses on the accuracy of the depth map, where an evaluation on a publicly available test set such as the KITTI vision benchmark is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Tom van Dijk , Guido C. H. E. de Croon

Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or structure from motion),…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Pierluigi Zama Ramirez , Matteo Poggi , Fabio Tosi , Stefano Mattoccia , Luigi Di Stefano

We propose a depth map inference system from monocular videos based on a novel dataset for navigation that mimics aerial footage from gimbal stabilized monocular camera in rigid scenes. Unlike most navigation datasets, the lack of rotation…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Clément Pinard , Laure Chevalley , Antoine Manzanera , David Filliat

In this paper, we propose a novel method for monocular depth estimation in dynamic scenes. We first explore the arbitrariness of object's movement trajectory in dynamic scenes theoretically. To overcome the arbitrariness, we use assume that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Kebin Peng , John Quarles , Kevin Desai

Learning to predict scene depth from RGB inputs is a challenging task both for indoor and outdoor robot navigation. In this work we address unsupervised learning of scene depth and robot ego-motion where supervision is provided by monocular…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

In this paper, we propose a novel video depth estimation approach, FutureDepth, which enables the model to implicitly leverage multi-frame and motion cues to improve depth estimation by making it learn to predict the future at training.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Rajeev Yasarla , Manish Kumar Singh , Hong Cai , Yunxiao Shi , Jisoo Jeong , Yinhao Zhu , Shizhong Han , Risheek Garrepalli , Fatih Porikli

Monocular depth estimation has been actively studied in fields such as robot vision, autonomous driving, and 3D scene understanding. Given a sequence of color images, unsupervised learning methods based on the framework of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Songlin Wei , Guodong Chen , Wenzheng Chi , Zhenhua Wang , Lining Sun

We consider the problem of depth estimation from a single monocular image in this work. It is a challenging task as no reliable depth cues are available, e.g., stereo correspondences, motions, etc. Previous efforts have been focusing on…

Computer Vision and Pattern Recognition · Computer Science 2015-10-01 Fayao Liu , Chunhua Shen , Guosheng Lin

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach, that requires a lot of ground truths. Previous works have successfully improved the accuracy of depth…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Noriaki Hirose , Shun Taguchi , Keisuke Kawano , Satoshi Koide

As processing power has become more available, more human-like artificial intelligences are created to solve image processing tasks that we are inherently good at. As such we propose a model that estimates depth from a monocular image. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Fabian Truetsch , Alfred Schöttl

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi