English
Related papers

Related papers: Optical Flow in Mostly Rigid Scenes

200 papers

Optical Flow (OF) is the movement pattern of pixels or edges that is caused in a visual scene by the relative motion between an agent and a scene. OF is used in a wide range of computer vision algorithms and robotics applications. While the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Jonas Kühne , Michele Magno , Luca Benini

In moving camera videos, motion segmentation is commonly performed using the image plane motion of pixels, or optical flow. However, objects that are at different depths from the camera can exhibit different optical flows even if they share…

Computer Vision and Pattern Recognition · Computer Science 2015-11-06 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

We present a self-supervised approach to estimate flow in camera image and top-view grid map sequences using fully convolutional neural networks in the domain of automated driving. We extend existing approaches for self-supervised optical…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Sascha Wirges , Johannes Gräter , Qiuhao Zhang , Christoph Stiller

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

Optical flow is the motion of a pixel between at least two consecutive video frames and can be estimated through an end-to-end trainable convolutional neural network. To this end, large training datasets are required to improve the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Roman Seidel , André Apitzsch , Gangolf Hirtz

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Zhile Ren , Orazio Gallo , Deqing Sun , Ming-Hsuan Yang , Erik B. Sudderth , Jan Kautz

Estimation of 3D motion in a dynamic scene from a temporal pair of images is a core task in many scene understanding problems. In real world applications, a dynamic scene is commonly captured by a moving camera (i.e., panning, tilting or…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Zhaoyang Lv , Kihwan Kim , Alejandro Troccoli , Deqing Sun , James M. Rehg , Jan Kautz

Given two consecutive frames from a pair of stereo cameras, 3D scene flow methods simultaneously estimate the 3D geometry and motion of the observed scene. Many existing approaches use superpixels for regularization, but may predict…

Computer Vision and Pattern Recognition · Computer Science 2017-10-09 Zhile Ren , Deqing Sun , Jan Kautz , Erik B. Sudderth

The pel-recursive computation of 2-D optical flow has been extensively studied in computer vision to estimate motion from image sequences, but it still raises a wealth of issues, such as the treatment of outliers, motion discontinuities and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-04 Vania V. Estrela , Matthias O. Franz , Ricardo T. Lopes , G. P. De Araujo

The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Anurag Ranjan , David T. Hoffmann , Dimitrios Tzionas , Siyu Tang , Javier Romero , Michael J. Black

In most of computer vision applications, motion blur is regarded as an undesirable artifact. However, it has been shown that motion blur in an image may have practical interests in fundamental computer vision problems. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dawit Mureja Argaw , Junsik Kim , Francois Rameau , Jae Won Cho , In So Kweon

Interpreting motion captured in image sequences is crucial for a wide range of computer vision applications. Typical estimation approaches include optical flow (OF), which approximates the apparent motion instantaneously in a scene, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Tanner D. Harms , Steven L. Brunton , Beverley J. McKeon

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

Given two consecutive RGB-D images, we propose a model that estimates a dense 3D motion field, also known as scene flow. We take advantage of the fact that in robot manipulation scenarios, scenes often consist of a set of rigidly moving…

Robotics · Computer Science 2018-07-25 Lin Shao , Parth Shah , Vikranth Dwaracherla , Jeannette Bohg

Optical flow is a fundamental technique for motion estimation, widely applied in video stabilization, interpolation, and object tracking. Traditional optical flow estimation methods rely on restrictive assumptions like brightness constancy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yu-Hsi Chen , Chin-Tien Wu

Extracting information on fluid motion directly from images is challenging. Fluid flow represents a complex dynamic system governed by the Navier-Stokes equations. General optical flow methods are typically designed for rigid body motion,…

Machine Learning · Computer Science 2022-06-23 Mingrui Zhang , Jianhong Wang , James Tlhomole , Matthew D. Piggott

With the advent of neuromorphic vision sensors such as event-based cameras, a paradigm shift is required for most computer vision algorithms. Among these algorithms, optical flow estimation is a prime candidate for this process considering…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Mahmoud Z. Khairallah , Fabien Bonardi , David Roussel , Samia Bouchafa

The accuracy of learning-based optical flow estimation models heavily relies on the realism of the training datasets. Current approaches for generating such datasets either employ synthetic data or generate images with limited realism.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yingping Liang , Jiaming Liu , Debing Zhang , Ying Fu