English
Related papers

Related papers: LiteFlowNet3: Resolving Correspondence Ambiguity f…

200 papers

Optical flow estimation is a classical yet challenging task in computer vision. One of the essential factors in accurately predicting optical flow is to alleviate occlusions between frames. However, it is still a thorny problem for current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shangkun Sun , Yuanqi Chen , Yu Zhu , Guodong Guo , Ge Li

We propose a new pipeline for optical flow computation, based on Deep Learning techniques. We suggest using a Siamese CNN to independently, and in parallel, compute the descriptors of both images. The learned descriptors are then compared…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 David Gadot , Lior Wolf

Conventional training for optical flow and stereo depth models typically employs a uniform loss function across all pixels. However, this one-size-fits-all approach often overlooks the significant variations in learning difficulty among…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jisoo Jeong , Hong Cai , Jamie Menjay Lin , Fatih Porikli

State-of-the-art neural network models estimate large displacement optical flow in multi-resolution and use warping to propagate the estimation between two resolutions. Despite their impressive results, it is known that there are two…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Yao Lu , Jack Valmadre , Heng Wang , Juho Kannala , Mehrtash Harandi , Philip H. S. Torr

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Nikolaus Mayer , Eddy Ilg , Philip Häusser , Philipp Fischer , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Estimating per-pixel motion between video frames, known as optical flow, is a long-standing problem in video understanding and analysis. Most contemporary optical flow techniques largely focus on addressing the cross-image matching with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Ao Luo , Fan Yang , Kunming Luo , Xin Li , Haoqiang Fan , Shuaicheng Liu

We propose a novel approach for optical flow estimation , targeted at large displacements with significant oc-clusions. It consists of two steps: i) dense matching by edge-preserving interpolation from a sparse set of matches; ii)…

Computer Vision and Pattern Recognition · Computer Science 2015-05-20 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

Classical approaches for estimating optical flow have achieved rapid progress in the last decade. However, most of them are too slow to be applied in real-time video analysis. Due to the great success of deep learning, recent work has…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Yi Zhu , Shawn Newsam

State-of-the-art neural network models for optical flow estimation require a dense correlation volume at high resolutions for representing per-pixel displacement. Although the dense correlation volume is informative for accurate estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Shihao Jiang , Yao Lu , Hongdong Li , Richard Hartley

Optical flow estimation is a fundamental task in computer vision. Recent direct-regression methods using deep neural networks achieve remarkable performance improvement. However, they do not explicitly capture long-term motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shiyu Zhao , Long Zhao , Zhixing Zhang , Enyu Zhou , Dimitris Metaxas

We propose a novel representation for dense pixel-wise estimation tasks using CNNs that boosts accuracy and reduces training time, by explicitly exploiting joint coarse-and-fine reasoning. The coarse reasoning is performed over a discrete…

Computer Vision and Pattern Recognition · Computer Science 2018-08-23 Victor Vaquero , German Ros , Francesc Moreno-Noguer , Antonio M. Lopez , Alberto Sanfeliu

Convolutional neural networks (CNNs) have recently been very successful in a variety of computer vision tasks, especially on those linked to recognition. Optical flow estimation has not been among the tasks where CNNs were successful. In…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Philipp Fischer , Alexey Dosovitskiy , Eddy Ilg , Philip Häusser , Caner Hazırbaş , Vladimir Golkov , Patrick van der Smagt , Daniel Cremers , Thomas Brox

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

We introduce a novel matching algorithm, called DeepMatching, to compute dense correspondences between images. DeepMatching relies on a hierarchical, multi-layer, correlational architecture designed for matching images and was inspired by…

Computer Vision and Pattern Recognition · Computer Science 2015-10-12 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

Deep learning approaches to optical flow estimation have seen rapid progress over the recent years. One common trait of many networks is that they refine an initial flow estimate either through multiple stages or across the levels of a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Junhwa Hur , Stefan Roth

In the last few years, convolutional neural networks (CNNs) have demonstrated increasing success at learning many computer vision tasks including dense estimation problems such as optical flow and stereo matching. However, the joint…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Rohan Saxena , René Schuster , Oliver Wasenmüller , Didier Stricker

Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U$^{2}$Flow, the first recurrent unsupervised framework that jointly estimates optical flow and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xunpei Sun , Wenwei Lin , Yi Chang , Gang Chen

We present a framework to use recently introduced Capsule Networks for solving the problem of Optical Flow, one of the fundamental computer vision tasks. Most of the existing state of the art deep architectures either uses a correlation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Rahul Chand , Rajat Arora , K Ram Prabhakar , R Venkatesh Babu

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chanuka Algama , Kasun Amarasinghe

Significant attention has been attracted to deep learning-based depth estimates. Dynamic objects become the most hard problems in inter-frame-supervised depth estimates due to the uncertainty in adjacent frames. Thus, integrating optical…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zhengyang Lu , Ying Chen