English
Related papers

Related papers: How Do Neural Networks Estimate Optical Flow? A Ne…

200 papers

Existing analyses of optimization in deep learning are either continuous, focusing on (variants of) gradient flow, or discrete, directly treating (variants of) gradient descent. Gradient flow is amenable to theoretical analysis, but is…

Machine Learning · Computer Science 2021-12-30 Omer Elkabetz , Nadav Cohen

Optical flow estimation is an essential step for many real-world computer vision tasks. Existing deep networks have achieved satisfactory results by mostly employing a pyramidal coarse-to-fine paradigm, where a key process is to adopt…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Lingtong Kong , Xiaohang Yang , Jie Yang

Optical flow estimation is very challenging in situations with transparent or occluded objects. In this work, we address these challenges at the task level by introducing Amodal Optical Flow, which integrates optical flow with amodal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Maximilian Luz , Rohit Mohan , Ahmed Rida Sekkat , Oliver Sawade , Elmar Matthes , Thomas Brox , Abhinav Valada

Deblurring can not only provide visually more pleasant pictures and make photography more convenient, but also can improve the performance of objection detection as well as tracking. However, removing dynamic scene blur from images is a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Jiawei Zhang , Jinshan Pan , Daoye Wang , Shangchen Zhou , Xing Wei , Furong Zhao , Jianbo Liu , Jimmy Ren

Traditionally, the vision community has devised algorithms to estimate the distance between an original image and images that have been subject to perturbations. Inspiration was usually taken from the human visual perceptual system and how…

Machine Learning · Computer Science 2020-11-18 Alexander Hepburn , Valero Laparra , Jesús Malo , Ryan McConville , Raul Santos-Rodriguez

The performance of optical flow algorithms greatly depends on the specifics of the content and the application for which it is used. Existing and well established optical flow datasets are limited to rather particular contents from which…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Gregory Schröder , Tobias Senst , Erik Bochinski , Thomas Sikora

This paper proposes a framework to guide an optical flow network with external cues to achieve superior accuracy either on known or unseen domains. Given the availability of sparse yet accurate optical flow hints from an external source,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Matteo Poggi , Filippo Aleotti , Stefano Mattoccia

This paper introduces a novel neural network - flow completion network (FCN) - to infer the fluid dynamics, includ-ing the flow field and the force acting on the body, from the incomplete data based on Graph Convolution AttentionNetwork.…

Fluid Dynamics · Physics 2022-08-24 Xiaodong He , Yinan Wang , Juan Li

Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Ali K. Z. Tehrani , Morteza Mirzaei , Hassan Rivaz

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Mathematical optimization is widely used in various research fields. With a carefully-designed objective function, mathematical optimization can be quite helpful in solving many problems. However, objective functions are usually…

Machine Learning · Computer Science 2019-05-27 Younghan Jeon , Minsik Lee , Jin Young Choi

Given a scene, what is going to move, and in what direction will it move? Such a question could be considered a non-semantic form of action prediction. In this work, we present a convolutional neural network (CNN) based approach for motion…

Computer Vision and Pattern Recognition · Computer Science 2015-12-18 Jacob Walker , Abhinav Gupta , Martial Hebert

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

This paper introduces a new method for inter-frame coding based on two complementary autoencoders: MOFNet and CodecNet. MOFNet aims at computing and conveying the Optical Flow and a pixel-wise coding Mode selection. The optical flow is used…

Image and Video Processing · Electrical Eng. & Systems 2020-08-07 Théo Ladune , Pierrick Philippe , Wassim Hamidouche , Lu Zhang , Olivier Déforges

Complex fluids flow in complex ways in complex structures. Transport of water and various organic and inorganic molecules in the central nervous system are important in a wide range of biological and medical processes [C. Nicholson, and S.…

Biological Physics · Physics 2021-05-19 Yi Zhu , Shixin Xu , Robert S. Eisenberg , Huaxiong Huang

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

Optimal Power Flow (OPF) is a fundamental problem in power systems. It is computationally challenging and a recent line of research has proposed the use of Deep Neural Networks (DNNs) to find OPF approximations at vastly reduced runtimes…

Machine Learning · Computer Science 2021-11-23 My H. Dinh , Ferdinando Fioretto , Mostafa Mohammadian , Kyri Baker

This paper deals with the scarcity of data for training optical flow networks, highlighting the limitations of existing sources such as labeled synthetic datasets or unlabeled real videos. Specifically, we introduce a framework to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Filippo Aleotti , Matteo Poggi , Stefano Mattoccia

Accurate estimation of sea ice drift is critical for Arctic navigation, climate research, and operational forecasting. While optical flow, a computer vision technique for estimating pixel wise motion between consecutive images, has advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Daniela Martin , Joseph Gallego