English
Related papers

Related papers: Continual Occlusions and Optical Flow Estimation

200 papers

Feature warping is a core technique in optical flow estimation; however, the ambiguity caused by occluded areas during warping is a major problem that remains unsolved. In this paper, we propose an asymmetric occlusion-aware feature…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Shengyu Zhao , Yilun Sheng , Yue Dong , Eric I-Chao Chang , Yan Xu

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

Optical flow estimation with occlusion or large displacement is a problematic challenge due to the lost of corresponding pixels between consecutive frames. In this paper, we discover that the lost information is related to a large quantity…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yang Jiao , Guangming Shi , Trac D. Tran

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chanuka Algama , Kasun Amarasinghe

We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out moving objects from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Tatsunori Taniai , Sudipta N. Sinha , Yoichi Sato

Occlusions pose a significant challenge to optical flow algorithms that even rely on global evidences. We consider an occluded point to be one that is imaged in the reference frame but not in the next. Estimating the motion of these points…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yu Jing , Tan Yujuan , Ren Ao , Liu Duo

Significant attention has been attracted to deep learning-based depth estimates. Dynamic objects become the most hard problems in inter-frame-supervised depth estimates due to the uncertainty in adjacent frames. Thus, integrating optical…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zhengyang Lu , Ying Chen

Optical flow estimation is a well-studied topic for automated driving applications. Many outstanding optical flow estimation methods have been proposed, but they become erroneous when tested in challenging scenarios that are commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Shihao Shen , Louis Kerofsky , Senthil Yogamani

To apply optical flow in practice, it is often necessary to resize the input to smaller dimensions in order to reduce computational costs. However, downsizing inputs makes the estimation more challenging because objects and motion ranges…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Hyunyoung Jung , Zhuo Hui , Lei Luo , Haitao Yang , Feng Liu , Sungjoo Yoo , Rakesh Ranjan , Denis Demandolx

Existing recurrent optical flow estimation networks are computationally expensive since they use a fixed large number of iterations to update the flow field for each sample. An efficient network should skip iterations when the flow…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Ri Cheng , Ruian He , Xuhao Jiang , Shili Zhou , Weimin Tan , Bo Yan

We propose a novel approach for optical flow estimation , targeted at large displacements with significant oc-clusions. It consists of two steps: i) dense matching by edge-preserving interpolation from a sparse set of matches; ii)…

Computer Vision and Pattern Recognition · Computer Science 2015-05-20 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of scene flow estimation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 René Schuster , Oliver Wasenmüller , Christian Unger , Georg Kuschk , Didier Stricker

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Temporal coherence is a valuable source of information in the context of optical flow estimation. However, finding a suitable motion model to leverage this information is a non-trivial task. In this paper we propose an unsupervised online…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daniel Maurer , Andrés Bruhn

CNN-based optical flow estimation has attracted attention recently, mainly due to its impressively high frame rates. These networks perform well on synthetic datasets, but they are still far behind the classical methods in real-world…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Nima Sedaghat , Mohammadreza Zolfaghari , Thomas Brox

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

In the last few years, convolutional neural networks (CNNs) have demonstrated increasing success at learning many computer vision tasks including dense estimation problems such as optical flow and stereo matching. However, the joint…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Rohan Saxena , René Schuster , Oliver Wasenmüller , Didier Stricker

We present DistillFlow, a knowledge distillation approach to learning optical flow. DistillFlow trains multiple teacher models and a student model, where challenging transformations are applied to the input of the student model to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Pengpeng Liu , Michael R. Lyu , Irwin King , Jia Xu