English
Related papers

Related papers: Optical Flow Estimation in the Deep Learning Age

200 papers

Optimal Power Flow (OPF) is a fundamental problem in power systems. It is computationally challenging and a recent line of research has proposed the use of Deep Neural Networks (DNNs) to find OPF approximations at vastly reduced runtimes…

Machine Learning · Computer Science 2021-11-23 My H. Dinh , Ferdinando Fioretto , Mostafa Mohammadian , Kyri Baker

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Nikolaus Mayer , Eddy Ilg , Philip Häusser , Philipp Fischer , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Deblurring can not only provide visually more pleasant pictures and make photography more convenient, but also can improve the performance of objection detection as well as tracking. However, removing dynamic scene blur from images is a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Jiawei Zhang , Jinshan Pan , Daoye Wang , Shangchen Zhou , Xing Wei , Furong Zhao , Jianbo Liu , Jimmy Ren

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chanuka Algama , Kasun Amarasinghe

In this paper, we propose a convolutional layer inspired by optical flow algorithms to learn motion representations. Our representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 AJ Piergiovanni , Michael S. Ryoo

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Optical flow is a fundamental technique for motion estimation, widely applied in video stabilization, interpolation, and object tracking. Traditional optical flow estimation methods rely on restrictive assumptions like brightness constancy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yu-Hsi Chen , Chin-Tien Wu

Large machine learning models based on Convolutional Neural Networks (CNNs) with rapidly increasing number of parameters, trained with massive amounts of data, are being deployed in a wide array of computer vision tasks from self-driving…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Rishab Parthasarathy , Rohan Bhowmik

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

Even with the recent advances in convolutional neural networks (CNN) in various visual recognition tasks, the state-of-the-art action recognition system still relies on hand crafted motion feature such as optical flow to achieve the best…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Joe Yue-Hei Ng , Jonghyun Choi , Jan Neumann , Larry S. Davis

Motion estimation is one of the core challenges in computer vision. With traditional dual-frame approaches, occlusions and out-of-view motions are a limiting factor, especially in the context of environmental perception for vehicles due to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 René Schuster , Christian Unger , Didier Stricker

The video and action classification have extremely evolved by deep neural networks specially with two stream CNN using RGB and optical flow as inputs and they present outstanding performance in terms of video analysis. One of the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Ali Diba , Ali Mohammad Pazandeh , Luc Van Gool

Recent works on optical flow estimation use neural networks to predict the flow field that maps positions of one image to positions of the other. These networks consist of a feature extractor, a correlation volume, and finally several…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Leyla Mirvakhabova , Hong Cai , Jisoo Jeong , Hanno Ackermann , Farhad Zanjani , Fatih Porikli

Most of the top performing action recognition methods use optical flow as a "black box" input. Here we take a deeper look at the combination of flow and action recognition, and investigate why optical flow is helpful, what makes a flow…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Laura Sevilla-Lara , Yiyi Liao , Fatma Guney , Varun Jampani , Andreas Geiger , Michael J. Black

The optical flow of humans is well known to be useful for the analysis of human action. Given this, we devise an optical flow algorithm specifically for human motion and show that it is superior to generic flow methods. Designing a method…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Anurag Ranjan , Javier Romero , Michael J. Black

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Nikolaus Mayer , Eddy Ilg , Philipp Fischer , Caner Hazirbas , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

We focus on a convolutional neural network (CNN), which has recently been utilized for fluid flow analyses, from the perspective on the influence of various operations inside it by considering some canonical regression problems with fluid…

Fluid Dynamics · Physics 2021-08-18 Masaki Morimoto , Kai Fukami , Kai Zhang , Aditya G. Nair , Koji Fukagata

Convolutional neural networks (CNNs) have recently been applied to predict or model fluid dynamics. However, mechanisms of CNNs for learning fluid dynamics are still not well understood, while such understanding is highly necessary to…

Fluid Dynamics · Physics 2021-04-06 Sangseung Lee , Donghyun You

The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Anurag Ranjan , David T. Hoffmann , Dimitrios Tzionas , Siyu Tang , Javier Romero , Michael J. Black