English
Related papers

Related papers: FlowNet 2.0: Evolution of Optical Flow Estimation …

200 papers

Even with the recent advances in convolutional neural networks (CNN) in various visual recognition tasks, the state-of-the-art action recognition system still relies on hand crafted motion feature such as optical flow to achieve the best…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Joe Yue-Hei Ng , Jonghyun Choi , Jan Neumann , Larry S. Davis

Standard frame-based cameras that sample light intensity frames are heavily impacted by motion blur for high-speed motion and fail to perceive scene accurately when the dynamic range is high. Event-based cameras, on the other hand, overcome…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Chankyu Lee , Adarsh Kumar Kosta , Kaushik Roy

Optical flow estimation is a fundamental task in computer vision. Recent direct-regression methods using deep neural networks achieve remarkable performance improvement. However, they do not explicitly capture long-term motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shiyu Zhao , Long Zhao , Zhixing Zhang , Enyu Zhou , Dimitris Metaxas

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Anurag Ranjan , David T. Hoffmann , Dimitrios Tzionas , Siyu Tang , Javier Romero , Michael J. Black

Optical flow estimation is a critical task for tiny mobile robotics to enable safe and accurate navigation, obstacle avoidance, and other functionalities. However, optical flow estimation on tiny robots is challenging due to limited onboard…

Robotics · Computer Science 2025-02-13 Sai Ramana Kiran Pinnama Raju , Rishabh Singh , Manoj Velmurugan , Nitin J. Sanket

Current deep neural network approaches for camera pose estimation rely on scene structure for 3D motion estimation, but this decreases the robustness and thereby makes cross-dataset generalization difficult. In contrast, classical…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chethan M. Parameshwara , Gokul Hari , Cornelia Fermüller , Nitin J. Sanket , Yiannis Aloimonos

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chanuka Algama , Kasun Amarasinghe

Optical flow estimation is one of the fundamental tasks in low-level computer vision, which describes the pixel-wise displacement and can be used in many other tasks. From the apparent aspect, the optical flow can be viewed as the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Yuhao Cheng , Siru Zhang , Yiqiang Yan

Dense and versatile image representations underpin the success of virtually all computer vision applications. However, state-of-the-art networks, such as transformers, produce low-resolution feature grids, which are suboptimal for dense…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Nikita Araslanov , Anna Sonnweber , Daniel Cremers

Event cameras such as DAVIS can simultaneously output high temporal resolution events and low frame-rate intensity images, which own great potential in capturing scene motion, such as optical flow estimation. Most of the existing optical…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zhexiong Wan , Yuchao Dai , Yuxin Mao

Optical flow techniques are becoming increasingly performant and robust when estimating motion in a scene, but their performance has yet to be proven in the area of facial expression recognition. In this work, a variety of optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Benjamin Allaert , Isaac Ronald Ward , Ioan Marius Bilasco , Chaabane Djeraba , Mohammed Bennamoun

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

We present FlowNet3D++, a deep scene flow estimation network. Inspired by classical methods, FlowNet3D++ incorporates geometric constraints in the form of point-to-plane distance and angular alignment between individual vectors in the flow…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Zirui Wang , Shuda Li , Henry Howard-Jenkins , Victor Adrian Prisacariu , Min Chen

Real-time high-accuracy optical flow estimation is critical for a variety of real-world robotic applications. However, current learning-based methods often struggle to balance accuracy and computational efficiency: methods that achieve high…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhiyong Zhang , Aniket Gupta , Huaizu Jiang , Hanumant Singh

Two-stream networks have been very successful for solving the problem of action detection. However, prior work using two-stream networks train both streams separately, which prevents the network from exploiting regularities between the two…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Alaaeldin El-Nouby , Graham W. Taylor

The proposed RMS-FlowNet is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation which can operate on point clouds of high density. For hierarchical scene flow estimation, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Ramy Battrawy , René Schuster , Mohammad-Ali Nikouei Mahani , Didier Stricker

Existing optical flow estimators usually employ the network architectures typically designed for image classification as the encoder to extract per-pixel features. However, due to the natural difference between the tasks, the architectures…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Zhiwei Lin , Tingting Liang , Taihong Xiao , Yongtao Wang , Zhi Tang , Ming-Hsuan Yang

Temporal coherence is a valuable source of information in the context of optical flow estimation. However, finding a suitable motion model to leverage this information is a non-trivial task. In this paper we propose an unsupervised online…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daniel Maurer , Andrés Bruhn

We propose to incorporate feature correlation and sequential processing into dense optical flow estimation from event cameras. Modern frame-based optical flow methods heavily rely on matching costs computed from feature correlation. In…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Mathias Gehrig , Mario Millhäusler , Daniel Gehrig , Davide Scaramuzza