English
Related papers

Related papers: Unsupervised Joint Learning of Depth, Optical Flow…

200 papers

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley

In autonomous driving, monocular sequences contain lots of information. Monocular depth estimation, camera ego-motion estimation and optical flow estimation in consecutive frames are high-profile concerns recently. By analyzing tasks above,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Guangming Wang , Chi Zhang , Hesheng Wang , Jingchuan Wang , Yong Wang , Xinlei Wang

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

Significant attention has been attracted to deep learning-based depth estimates. Dynamic objects become the most hard problems in inter-frame-supervised depth estimates due to the uncertainty in adjacent frames. Thus, integrating optical…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zhengyang Lu , Ying Chen

Learning depth and optical flow via deep neural networks by watching videos has made significant progress recently. In this paper, we jointly solve the two tasks by exploiting the underlying geometric rules within stereo videos.…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Yang Wang , Zhenheng Yang , Peng Wang , Yi Yang , Chenxu Luo , Wei Xu

We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Dipan Mandal , Abhilash Jain

We present a novel approach for unsupervised learning of depth and ego-motion from monocular video. Unsupervised learning removes the need for separate supervisory signals (depth or ego-motion ground truth, or multi-view video). Prior work…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Reza Mahjourian , Martin Wicke , Anelia Angelova

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler

Unsupervised methods have showed promising results on monocular depth estimation. However, the training data must be captured in scenes without moving objects. To push the envelope of accuracy, recent methods tend to increase their model…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Tak-Wai Hui

Unsupervised learning based depth estimation methods have received more and more attention as they do not need vast quantities of densely labeled data for training which are touch to acquire. In this paper, we propose a novel unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Lingtao Zhou , Jiaojiao Fang , Guizhong Liu

Learning to estimate 3D geometry in a single image by watching unlabeled videos via deep convolutional network has made significant process recently. Current state-of-the-art (SOTA) methods, are based on the learning framework of rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Zhenheng Yang , Peng Wang , Yang Wang , Wei Xu , Ram Nevatia

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Jianrong Wang , Ge Zhang , Zhenyu Wu , XueWei Li , Li Liu

Although considerable advancements have been attained in self-supervised depth estimation from monocular videos, most existing methods often treat all objects in a video as static entities, which however violates the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xiuzhe Wu , Xiaoyang Lyu , Qihao Huang , Yong Liu , Yang Wu , Ying Shan , Xiaojuan Qi

Self-supervised deep learning-based 3D scene understanding methods can overcome the difficulty of acquiring the densely labeled ground-truth and have made a lot of advances. However, occlusions and moving objects are still some of the major…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jiaojiao Fang , Guizhong Liu

Monocular depth estimation has been actively studied in fields such as robot vision, autonomous driving, and 3D scene understanding. Given a sequence of color images, unsupervised learning methods based on the framework of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Songlin Wei , Guodong Chen , Wenzheng Chi , Zhenhua Wang , Lining Sun

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabeled monocular video.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Jiquan Zhong , Shijie Zhao , Wenhua Wu , Zhe Liu , Hesheng Wang
‹ Prev 1 2 3 10 Next ›