English
Related papers

Related papers: Rethinking Optical Flow from Geometric Matching Co…

200 papers

Both optical flow and stereo disparities are image matches and can therefore benefit from joint training. Depth and 3D motion provide geometric rather than photometric information and can further improve optical flow. Accordingly, we design…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuai Yuan , Carlo Tomasi

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

We learn to compute optical flow by combining a classical spatial-pyramid formulation with deep learning. This estimates large motions in a coarse-to-fine approach by warping one image of a pair at each pyramid level by the current flow…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Anurag Ranjan , Michael J. Black

Gathering data and identifying events in various traffic situations remains an essential challenge for the systematic evaluation of a perception system's performance. Analyzing large-scale, typically unstructured, multi-modal, time series…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Tayssir Bouraffa , Elias Kjellberg Carlson , Erik Wessman , Ali Nouri , Pierre Lamart , Christian Berger

In optical flow estimation task, coarse-to-fine (C2F) warping strategy is widely used to deal with the large displacement problem and provides efficiency and speed. However, limited by the small search range between the first images and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Suihanjin Yu , Youmin Zhang , Chen Wang , Xiao Bai , Liang Zhang , Edwin R. Hancock

Recent advances in optical flow estimation have prioritized accuracy at the cost of growing GPU memory consumption, particularly for high-resolution (FullHD) inputs. We introduce MEMFOF, a memory-efficient multi-frame optical flow method…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Vladislav Bargatin , Egor Chistov , Alexander Yakovenko , Dmitriy Vatolin

Generating high-quality time-series data is challenging because real-world signals often exhibit multimodal patterns and multiscale dynamics, including oscillations and high-frequency variations. Flow Matching (FM) offers an efficient…

Machine Learning · Computer Science 2026-05-29 Junru Zhang , Lang Feng , Jinbo Wang , Xu Guo , Yucheng Wang , Han Yu , Min Wu , Yabo Dong , Duanqing Xu

We present CompactFlowNet, the first real-time mobile neural network for optical flow prediction, which involves determining the displacement of each pixel in an initial frame relative to the corresponding pixel in a subsequent frame.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Andrei Znobishchev , Valerii Filev , Oleg Kudashev , Nikita Orlov , Humphrey Shi

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Over four decades, the majority addresses the problem of optical flow estimation using variational methods. With the advance of machine learning, some recent works have attempted to address the problem using convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Tak-Wai Hui , Xiaoou Tang , Chen Change Loy

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chanuka Algama , Kasun Amarasinghe

Many recent state-of-the-art (SOTA) optical flow models use finite-step recurrent update operations to emulate traditional algorithms by encouraging iterative refinements toward a stable flow estimation. However, these RNNs impose large…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Shaojie Bai , Zhengyang Geng , Yash Savani , J. Zico Kolter

Existing optical flow methods are erroneous in challenging scenes, such as fog, rain, and night because the basic optical flow assumptions such as brightness and gradient constancy are broken. To address this problem, we present an…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Haipeng Li , Kunming Luo , Shuaicheng Liu

Event cameras have shown promise in vision applications like optical flow estimation and stereo matching, with many specialized architectures leveraging the asynchronous and sparse nature of event data. However, existing works only focus…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Pengjie Zhang , Lin Zhu , Xiao Wang , Lizhi Wang , Wanxuan Lu , Hua Huang

The optical flow of natural scenes is a combination of the motion of the observer and the independent motion of objects. Existing algorithms typically focus on either recovering motion and structure under the assumption of a purely static…

Computer Vision and Pattern Recognition · Computer Science 2017-05-04 Jonas Wulff , Laura Sevilla-Lara , Michael J. Black

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

We present a self-supervised learning approach for optical flow. Our method distills reliable flow estimations from non-occluded pixels, and uses these predictions as ground truth to learn optical flow for hallucinated occlusions. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Pengpeng Liu , Michael Lyu , Irwin King , Jia Xu

The estimation of optical flow is an ambiguous task due to the lack of correspondence at occlusions, shadows, reflections, lack of texture and changes in illumination over time. Thus, unsupervised methods face major challenges as they need…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Adrian Wälchli , Paolo Favaro

Despite the progress of learning-based methods for 6D object pose estimation, the trade-off between accuracy and scalability for novel objects still exists. Specifically, previous methods for novel objects do not make good use of the target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sungphill Moon , Hyeontae Son , Dongcheol Hur , Sangwook Kim

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego