English
Related papers

Related papers: FlowNet: Learning Optical Flow with Convolutional …

200 papers

Optical flow estimation is a crucial subfield of computer vision, serving as a foundation for video tasks. However, the real-world robustness is limited by animated synthetic datasets for training. This introduces domain gaps when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yingping Liang , Ying Fu , Yutao Hu , Wenqi Shao , Jiaming Liu , Debing Zhang

Dense optical flow estimation is challenging when there are large displacements in a scene with heterogeneous motion dynamics, occlusion, and scene homogeneity. Traditional approaches to handle these challenges include hierarchical and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Ali Salehi , Madhusudhanan Balasubramanian

Convolutional neural networks (CNNs) have so far been the de-facto model for visual data. Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or even superior performance on image classification tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Maithra Raghu , Thomas Unterthiner , Simon Kornblith , Chiyuan Zhang , Alexey Dosovitskiy

This paper introduces a novel neural network - flow completion network (FCN) - to infer the fluid dynamics, includ-ing the flow field and the force acting on the body, from the incomplete data based on Graph Convolution AttentionNetwork.…

Fluid Dynamics · Physics 2022-08-24 Xiaodong He , Yinan Wang , Juan Li

In this survey paper, we review recent uses of convolution neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Michael T. McCann , Kyong Hwan Jin , Michael Unser

Convolutional Neural Networks (CNNs) are successfully used for the important automotive visual perception tasks including object recognition, motion and depth estimation, visual SLAM, etc. However, these tasks are typically independently…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ganesh Sistu , Isabelle Leang , Sumanth Chennupati , Senthil Yogamani , Ciaran Hughes , Stefan Milz , Samir Rawashdeh

Existing optical flow estimators usually employ the network architectures typically designed for image classification as the encoder to extract per-pixel features. However, due to the natural difference between the tasks, the architectures…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Zhiwei Lin , Tingting Liang , Taihong Xiao , Yongtao Wang , Zhi Tang , Ming-Hsuan Yang

Deep Convolutional Neural Networks (CNN) have exhibited superior performance in many visual recognition tasks including image classification, object detection, and scene label- ing, due to their large learning capacity and resistance to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Miao Sun , Tony X. Han , Xun Xu , Ming-Chang Liu , Ahmad Khodayari-Rostamabad

This paper deals with the scarcity of data for training optical flow networks, highlighting the limitations of existing sources such as labeled synthetic datasets or unlabeled real videos. Specifically, we introduce a framework to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Filippo Aleotti , Matteo Poggi , Stefano Mattoccia

Sparse optical flow is widely used in various computer vision tasks, however assuming brightness consistency limits its performance in High Dynamic Range (HDR) environments. In this work, a lightweight network is used to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yicheng Lin , Shuo Wang , Yunlong Jiang , Bin Han

Convolutional Neural Networks (CNNs) filter the input data using spatial convolution operators with compact stencils. Commonly, the convolution operators couple features from all channels, which leads to immense computational cost in the…

Machine Learning · Computer Science 2019-05-17 Jonathan Ephrath , Lars Ruthotto , Eldad Haber , Eran Treister

Optical flow is the motion of a pixel between at least two consecutive video frames and can be estimated through an end-to-end trainable convolutional neural network. To this end, large training datasets are required to improve the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Roman Seidel , André Apitzsch , Gangolf Hirtz

It has been recently shown that a convolutional neural network can learn optical flow estimation with unsupervised learning. However, the performance of the unsupervised methods still has a relatively large gap compared to its supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Yang Wang , Yi Yang , Zhenheng Yang , Liang Zhao , Peng Wang , Wei Xu

In Convolutional Neural Networks (CNNs) information flows across a small neighbourhood of each pixel of an image, preventing long-range integration of features before reaching deep layers in the network. We propose a novel architecture that…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Federica Freddi , Jezabel R Garcia , Michael Bromberg , Sepehr Jalali , Da-Shan Shiu , Alvin Chua , Alberto Bernacchia

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Many state-of-the-art computer vision algorithms use large scale convolutional neural networks (CNNs) as basic building blocks. These CNNs are known for their huge number of parameters, high redundancy in weights, and tremendous computing…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Qiangui Huang , Kevin Zhou , Suya You , Ulrich Neumann

The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Anurag Ranjan , David T. Hoffmann , Dimitrios Tzionas , Siyu Tang , Javier Romero , Michael J. Black

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Optical flow estimation is a challenging problem remaining unsolved. Recent deep learning based optical flow models have achieved considerable success. However, these models often train networks from the scratch on standard optical flow…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Qiaole Dong , Chenjie Cao , Yanwei Fu