English
Related papers

Related papers: Occlusion Aware Unsupervised Learning of Optical F…

200 papers

Convolutional neural networks (CNNs) have recently been very successful in a variety of computer vision tasks, especially on those linked to recognition. Optical flow estimation has not been among the tasks where CNNs were successful. In…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Philipp Fischer , Alexey Dosovitskiy , Eddy Ilg , Philip Häusser , Caner Hazırbaş , Vladimir Golkov , Patrick van der Smagt , Daniel Cremers , Thomas Brox

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley

In the last few years, convolutional neural networks (CNNs) have demonstrated increasing success at learning many computer vision tasks including dense estimation problems such as optical flow and stereo matching. However, the joint…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Rohan Saxena , René Schuster , Oliver Wasenmüller , Didier Stricker

Light field disparity estimation is an essential task in computer vision with various applications. Although supervised learning-based methods have achieved both higher accuracy and efficiency than traditional optimization-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Peng Li , Jiayin Zhao , Jingyao Wu , Chao Deng , Haoqian Wang , Tao Yu

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

In this work, we propose a novel framework for unsupervised learning for event cameras that learns motion information from only the event stream. In particular, we propose an input representation of the events in the form of a discretized…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Alex Zihao Zhu , Liangzhe Yuan , Kenneth Chaney , Kostas Daniilidis

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Two optical flow estimation problems are addressed: i) occlusion estimation and handling, and ii) estimation from image sequences longer than two frames. The proposed ContinualFlow method estimates occlusions before flow, avoiding the use…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Michal Neoral , Jan Šochman , Jiří Matas

Motion estimation is one of the core challenges in computer vision. With traditional dual-frame approaches, occlusions and out-of-view motions are a limiting factor, especially in the context of environmental perception for vehicles due to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 René Schuster , Christian Unger , Didier Stricker

The occlusion problem remains a crucial challenge in optical flow estimation (OFE). Despite the recent significant progress brought about by deep learning, most existing deep learning OFE methods still struggle to handle occlusions; in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Bo Wang , Yifan Zhang , Jian Li , Yang Yu , Zhenping Sun , Li Liu , Dewen Hu

Estimating 3D occupancy and motion at the vehicle's surroundings is essential for autonomous driving, enabling situational awareness in dynamic environments. Existing approaches jointly learn geometry and motion but rely on expensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xavier Timoneda , Markus Herb , Fabian Duerr , Daniel Goehring

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

In recent years, deep neural networks showed their exceeding capabilities in addressing many computer vision tasks including scene flow prediction. However, most of the advances are dependent on the availability of a vast amount of dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Katharina Bendig , René Schuster , Didier Stricker

The interpretation of ego motion and scene change is a fundamental task for mobile robots. Optical flow information can be employed to estimate motion in the surroundings. Recently, unsupervised optical flow estimation has become a research…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Hengli Wang , Rui Fan , Ming Liu

Estimating 3D scene flow from a sequence of monocular images has been gaining increased attention due to the simple, economical capture setup. Owing to the severe ill-posedness of the problem, the accuracy of current methods has been…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Junhwa Hur , Stefan Roth

Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisible if they do not…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Subhabrata Choudhury , Laurynas Karazija , Iro Laina , Andrea Vedaldi , Christian Rupprecht

Optical flow estimation is one of the most studied problems in computer vision, yet recent benchmark datasets continue to reveal problem areas of today's approaches. Occlusions have remained one of the key challenges. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Junhwa Hur , Stefan Roth

Despite recent advances, estimating optical flow remains a challenging problem in the presence of illumination change, large occlusions or fast movement. In this paper, we propose a novel optical flow estimation framework which can provide…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Inchul Choi , Arunava Banerjee

Optical flow estimation can be formulated as an end-to-end supervised learning problem, which yields estimates with a superior accuracy-runtime tradeoff compared to alternative methodology. In this paper, we make such networks estimate…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Eddy Ilg , Özgün Çiçek , Silvio Galesso , Aaron Klein , Osama Makansi , Frank Hutter , Thomas Brox

The estimation of optical flow is an ambiguous task due to the lack of correspondence at occlusions, shadows, reflections, lack of texture and changes in illumination over time. Thus, unsupervised methods face major challenges as they need…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Adrian Wälchli , Paolo Favaro