English
Related papers

Related papers: Self-Supervised Monocular Scene Flow Estimation

200 papers

We present GLNet, a self-supervised framework for learning depth, optical flow, camera pose and intrinsic parameters from monocular video - addressing the difficulty of acquiring realistic ground-truth for such tasks. We propose three…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yuhua Chen , Cordelia Schmid , Cristian Sminchisescu

In this article, we tackle the problem of depth estimation from single monocular images. Compared with depth estimation using multiple images such as stereo depth perception, depth from monocular images is much more challenging. Prior work…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Fayao Liu , Chunhua Shen , Guosheng Lin , Ian Reid

Depth is a vital piece of information for autonomous vehicles to perceive obstacles. Due to the relatively low price and small size of monocular cameras, depth estimation from a single RGB image has attracted great interest in the research…

Robotics · Computer Science 2021-11-25 Xingshuai Dong , Matthew A. Garratt , Sreenatha G. Anavatti , Hussein A. Abbass

3D object detection based on monocular camera data is a key enabler for autonomous driving. The task however, is ill-posed due to lack of depth information in 2D images. Recent deep learning methods show promising results to recover depth…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Fabian Brunhuber , Simon Janssen , Johannes Betz , Markus Lienkamp

Optical flow estimation is a classical yet challenging task in computer vision. One of the essential factors in accurately predicting optical flow is to alleviate occlusions between frames. However, it is still a thorny problem for current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shangkun Sun , Yuanqi Chen , Yu Zhu , Guodong Guo , Ge Li

Dense and accurate 3D mapping from a monocular sequence is a key technology for several applications and still an open research area. This paper leverages recent results on single-view CNN-based depth estimation and fuses them with…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 José M. Fácil , Alejo Concha , Luis Montesano , Javier Civera

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Anh-Quan Cao , Raoul de Charette

Monocular depth estimation from a single image is an ill-posed problem for computer vision due to insufficient reliable cues as the prior knowledge. Besides the inter-frame supervision, namely stereo and adjacent frames, extensive prior…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Zhengyang Lu , Ying Chen

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of scene flow estimation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 René Schuster , Oliver Wasenmüller , Christian Unger , Georg Kuschk , Didier Stricker

Depth estimation is critical for any robotic system. In the past years estimation of depth from monocular images have shown great improvement, however, in the underwater environment results are still lagging behind due to appearance changes…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Shlomi Amitai , Itzik Klein , Tali Treibitz

This work presents DCFlow, a novel unsupervised cross-modal flow estimation framework that integrates a decoupled optimization strategy and a cross-modal consistency constraint. Unlike previous approaches that implicitly learn flow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Runmin Zhang , Jialiang Wang , Si-Yuan Cao , Zhu Yu , Junchen Yu , Guangyi Zhang , Hui-Liang Shen

Self-supervised monocular depth estimation approaches either ignore independently moving objects in the scene or need a separate segmentation step to identify them. We propose MonoDepthSeg to jointly estimate depth and segment moving…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sadra Safadoust , Fatma Güney

We present a novel approach for estimating depth from a monocular camera as it moves through complex and crowded indoor environments, e.g., a department store or a metro station. Our approach predicts absolute scale depth maps over the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Dongki Jung , Jaehoon Choi , Yonghan Lee , Deokhwa Kim , Changick Kim , Dinesh Manocha , Donghwan Lee

Neural networks have shown great success in extracting geometric information from color images. Especially, monocular depth estimation networks are increasingly reliable in real-world scenes. In this work we investigate the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Dominik Engel , Sebastian Hartwig , Timo Ropinski

Event cameras rely on motion to obtain information about scene appearance. This means that appearance and motion are inherently linked: either both are present and recorded in the event data, or neither is captured. Previous works treat the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Guo , Friedhelm Hamann , Guillermo Gallego

Estimating scene flow in RGB-D videos is attracting much interest of the computer vision researchers, due to its potential applications in robotics. The state-of-the-art techniques for scene flow estimation, typically rely on the knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Ravi Kumar Thakur , Snehasis Mukherjee

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

This paper studies unsupervised monocular depth prediction problem. Most of existing unsupervised depth prediction algorithms are developed for outdoor scenarios, while the depth prediction work in the indoor environment is still very…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Yinglong Feng , Shuncheng Wu , Okan Köpüklü , Xueyang Kang , Federico Tombari

We present a novel method to train machine learning algorithms to estimate scene depths from a single image, by using the information provided by a camera's aperture as supervision. Prior works use a depth sensor's outputs or images of the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Pratul P. Srinivasan , Rahul Garg , Neal Wadhwa , Ren Ng , Jonathan T. Barron

Learning without supervision how to predict 3D scene flows from point clouds is essential to many perception systems. We propose a novel learning framework for this task which improves the necessary regularization. Relying on the assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Karel Zimmermann , Patrick Perez , Tomas Svoboda