English
Related papers

Related papers: SciFlow: Empowering Lightweight Optical Flow Model…

200 papers

Significant progress has been made for estimating optical flow using deep neural networks. Advanced deep models achieve accurate flow estimation often with a considerable computation complexity and time-consuming training processes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Lingtong Kong , Jie Yang

Over four decades, the majority addresses the problem of optical flow estimation using variational methods. With the advance of machine learning, some recent works have attempted to address the problem using convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Tak-Wai Hui , Xiaoou Tang , Chen Change Loy

Event cameras capture brightness changes asynchronously with microsecond resolution, yet existing optical flow methods fail to fully exploit this temporal continuity. Frame-based approaches impose artificial accumulation latency and suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Gunwoo Jeon , Chaesong Park , Jongwoo Lim

Key-point-based scene understanding is fundamental for autonomous driving applications. At the same time, optical flow plays an important role in many vision tasks. However, due to the implicit bias of equal attention on all points, classic…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Zhonghua Yi , Hao Shi , Kailun Yang , Qi Jiang , Yaozu Ye , Ze Wang , Huajian Ni , Kaiwei Wang

Recent learning-based methods for event-based optical flow estimation utilize cost volumes for pixel matching but suffer from redundant computations and limited scalability to higher resolutions for flow refinement. In this work, we take…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Daikun Liu , Lei Cheng , Teng Wang , changyin Sun

We present a new lightweight CNN-based algorithm for multi-frame optical flow estimation. Our solution introduces a double recurrence over spatial scale and time through repeated use of a generic "STaR" (SpatioTemporal Recurrent) cell. It…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Pierre Godet , Alexandre Boulch , Aurélien Plyer , Guy Le Besnerais

Optical flow estimation is a well-studied topic for automated driving applications. Many outstanding optical flow estimation methods have been proposed, but they become erroneous when tested in challenging scenarios that are commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Shihao Shen , Louis Kerofsky , Senthil Yogamani

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

Real-time high-accuracy optical flow estimation is a crucial component in various applications, including localization and mapping in robotics, object tracking, and activity recognition in computer vision. While recent learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Zhiyong Zhang , Huaizu Jiang , Hanumant Singh

Optical flow estimation is one of the most studied problems in computer vision, yet recent benchmark datasets continue to reveal problem areas of today's approaches. Occlusions have remained one of the key challenges. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Junhwa Hur , Stefan Roth

Optical flow estimation with occlusion or large displacement is a problematic challenge due to the lost of corresponding pixels between consecutive frames. In this paper, we discover that the lost information is related to a large quantity…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yang Jiao , Guangming Shi , Trac D. Tran

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

In recent years, the LiDAR images, as a 2D compact representation of 3D LiDAR point clouds, are widely applied in various tasks, e.g., 3D semantic segmentation, LiDAR point cloud compression (PCC). Among these works, the optical flow…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Xuezhou Guo , Xuhu Lin , Lili Zhao , Zezhi Zhu , Jianwen Chen

We introduce VideoFlow, a novel optical flow estimation framework for videos. In contrast to previous methods that learn to estimate optical flow from two frames, VideoFlow concurrently estimates bi-directional optical flows for multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiaoyu Shi , Zhaoyang Huang , Weikang Bian , Dasong Li , Manyuan Zhang , Ka Chun Cheung , Simon See , Hongwei Qin , Jifeng Dai , Hongsheng Li

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Zhile Ren , Orazio Gallo , Deqing Sun , Ming-Hsuan Yang , Erik B. Sudderth , Jan Kautz

The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on data augmentation, they have yet to fully exploit the rich…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jisoo Jeong , Hong Cai , Risheek Garrepalli , Jamie Menjay Lin , Munawar Hayat , Fatih Porikli

We present DDFlow, a data distillation approach to learning optical flow estimation from unlabeled data. The approach distills reliable predictions from a teacher network, and uses these predictions as annotations to guide a student network…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Pengpeng Liu , Irwin King , Michael R. Lyu , Jia Xu

Optical flow is a fundamental technique for motion estimation, widely applied in video stabilization, interpolation, and object tracking. Traditional optical flow estimation methods rely on restrictive assumptions like brightness constancy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yu-Hsi Chen , Chin-Tien Wu

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

Optical flow estimation is an essential task in self-driving systems, which helps autonomous vehicles perceive temporal continuity information of surrounding scenes. The calculation of all-pair correlation plays an important role in many…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Hao Shi , Yifan Zhou , Kailun Yang , Xiaoting Yin , Kaiwei Wang