English
Related papers

Related papers: FlowNet: Learning Optical Flow with Convolutional …

200 papers

Recent efforts have shown machine learning to be useful for the prediction of nonlinear fluid dynamics. Predictive accuracy is often a central motivation for employing neural networks, but the pattern recognition central to the network…

Fluid Dynamics · Physics 2022-08-23 Shizheng Wen , Michael W. Lee , Kai M. Kruger Bastos , Earl H. Dowell

Significant progress has been made for estimating optical flow using deep neural networks. Advanced deep models achieve accurate flow estimation often with a considerable computation complexity and time-consuming training processes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Lingtong Kong , Jie Yang

Optical flow is an indispensable building block for various important computer vision tasks, including motion estimation, object tracking, and disparity measurement. In this work, we propose TransFlow, a pure transformer architecture for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yawen Lu , Qifan Wang , Siqi Ma , Tong Geng , Yingjie Victor Chen , Huaijin Chen , Dongfang Liu

Optical flow estimation is a classical yet challenging task in computer vision. One of the essential factors in accurately predicting optical flow is to alleviate occlusions between frames. However, it is still a thorny problem for current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shangkun Sun , Yuanqi Chen , Yu Zhu , Guodong Guo , Ge Li

Recently, convolutional networks (convnets) have proven useful for predicting optical flow. Much of this success is predicated on the availability of large datasets that require expensive and involved data acquisition and laborious la-…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Jason J. Yu , Adam W. Harley , Konstantinos G. Derpanis

In the last two years, convolutional neural networks (CNNs) have achieved an impressive suite of results on standard recognition datasets and tasks. CNN-based features seem poised to quickly replace engineered representations, such as SIFT…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Pulkit Agrawal , Ross Girshick , Jitendra Malik

We study the unsupervised learning of CNNs for optical flow estimation using proxy ground truth data. Supervised CNNs, due to their immense learning capacity, have shown superior performance on a range of computer vision problems including…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yi Zhu , Zhenzhong Lan , Shawn Newsam , Alexander G. Hauptmann

It is difficult to recover the motion field from a real-world footage given a mixture of camera shake and other photometric effects. In this paper we propose a hybrid framework by interleaving a Convolutional Neural Network (CNN) and a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Wenbin Li , Da Chen , Zhihan Lv , Yan Yan , Darren Cosker

Computing optical flow is a fundamental problem in computer vision. However, deep learning-based optical flow techniques do not perform well for non-rigid movements such as those found in faces, primarily due to lack of the training data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Muhannad Alkaddour , Usman Tariq , Abhinav Dhall

Synthetic datasets play a critical role in pre-training CNN models for optical flow, but they are painstaking to generate and hard to adapt to new applications. To automate the process, we present AutoFlow, a simple and effective method to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Deqing Sun , Daniel Vlasic , Charles Herrmann , Varun Jampani , Michael Krainin , Huiwen Chang , Ramin Zabih , William T. Freeman , Ce Liu

The convolutional neural network model for optical flow estimation usually outputs a low-resolution(LR) optical flow field. To obtain the corresponding full image resolution,interpolation and variational approach are the most common…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Liping Zhang , Zongqing Lu , Qingmin Liao

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

This paper addresses the challenge of dense pixel correspondence estimation between two images. This problem is closely related to optical flow estimation task where ConvNets (CNNs) have recently achieved significant progress. While optical…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Iaroslav Melekhov , Aleksei Tiulpin , Torsten Sattler , Marc Pollefeys , Esa Rahtu , Juho Kannala

Convolutional neural networks (CNNs) have achieved remarkable performance in various fields, particularly in the domain of computer vision. However, why this architecture works well remains to be a mystery. In this work we move a small step…

Machine Learning · Computer Science 2019-05-27 Bing Yu , Junzhao Zhang , Zhanxing Zhu

The Convolutional Neural Network (CNN) is a state-of-the-art architecture for a wide range of deep learning problems, the quintessential example of which is computer vision. CNNs principally employ the convolution operation, which can be…

Image and Video Processing · Electrical Eng. & Systems 2021-03-17 Edward Cottle , Florent Michel , Joseph Wilson , Nick New , Iman Kundu

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

Scene flow estimation is the task to predict the point-wise or pixel-wise 3D displacement vector between two consecutive frames of point clouds or images, which has important application in fields such as service robots and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Wang , Yunzhe Hu , Xinrui Wu , Hesheng Wang

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

In this work we describe a Convolutional Neural Network (CNN) to accurately predict the scene illumination. Taking image patches as input, the CNN works in the spatial domain without using hand-crafted features that are employed by most…

Computer Vision and Pattern Recognition · Computer Science 2015-04-20 Simone Bianco , Claudio Cusano , Raimondo Schettini

In the past few years, convolutional neural nets (CNN) have shown incredible promise for learning visual representations. In this paper, we use CNNs for the task of predicting surface normals from a single image. But what is the right…

Computer Vision and Pattern Recognition · Computer Science 2014-11-19 Xiaolong Wang , David F. Fouhey , Abhinav Gupta