English
Related papers

Related papers: A single coordinate framework for optic flow and b…

200 papers

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

Both optical flow and stereo disparities are image matches and can therefore benefit from joint training. Depth and 3D motion provide geometric rather than photometric information and can further improve optical flow. Accordingly, we design…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuai Yuan , Carlo Tomasi

Estimating per-pixel motion between video frames, known as optical flow, is a long-standing problem in video understanding and analysis. Most contemporary optical flow techniques largely focus on addressing the cross-image matching with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Ao Luo , Fan Yang , Kunming Luo , Xin Li , Haoqiang Fan , Shuaicheng Liu

In moving camera videos, motion segmentation is commonly performed using the image plane motion of pixels, or optical flow. However, objects that are at different depths from the camera can exhibit different optical flows even if they share…

Computer Vision and Pattern Recognition · Computer Science 2015-11-06 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

As we move through the world, the pattern of light projected on our eyes is complex and dynamic, yet we are still able to distinguish between moving and stationary objects. We propose that humans accomplish this by exploiting constraints…

Neurons and Cognition · Quantitative Biology 2025-05-14 Hope Lutwak , Bas Rokers , Eero P. Simoncelli

Video super-resolution is currently one of the most active research topics in computer vision as it plays an important role in many visual applications. Generally, video super-resolution contains a significant component, i.e., motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Zhigang Tu , Hongyan Li , Wei Xie , Yuanzhong Liu , Shifu Zhang , Baoxin Li , Junsong Yuan

Occlusions play an important role in disparity and optical flow estimation, since matching costs are not available in occluded areas and occlusions indicate depth or motion boundaries. Moreover, occlusions are relevant for motion…

Computer Vision and Pattern Recognition · Computer Science 2018-08-09 Eddy Ilg , Tonmoy Saikia , Margret Keuper , Thomas Brox

Most of the top performing action recognition methods use optical flow as a "black box" input. Here we take a deeper look at the combination of flow and action recognition, and investigate why optical flow is helpful, what makes a flow…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Laura Sevilla-Lara , Yiyi Liao , Fatma Guney , Varun Jampani , Andreas Geiger , Michael J. Black

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley

We extend the concept of optical flow to a dynamic non-Euclidean setting. Optical flow is traditionally computed from a sequence of flat images. It is the purpose of this paper to introduce variational motion estimation for images that are…

Optimization and Control · Mathematics 2013-05-22 Clemens Kirisits , Lukas F. Lang , Otmar Scherzer

We address the problem of motion estimation in images operating in the frequency domain. A method is presented which extends phase correlation to handle multiple motions present in an area. Our scheme is based on a novel Bilateral-Phase…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Vasileios Argyriou

We extend the concept of optical flow with spatiotemporal regularisation to a dynamic non-Euclidean setting. Optical flow is traditionally computed from a sequence of flat images. The purpose of this paper is to introduce variational motion…

Optimization and Control · Mathematics 2014-06-26 Clemens Kirisits , Lukas F. Lang , Otmar Scherzer

Optical flow estimation is crucial for various applications in vision and robotics. As the difficulty of collecting ground truth optical flow in real-world scenarios, most of the existing methods of learning optical flow still adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Sheng-Chi Huang , Wei-Chen Chiu

Optical flow estimation is one of the most studied problems in computer vision, yet recent benchmark datasets continue to reveal problem areas of today's approaches. Occlusions have remained one of the key challenges. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Junhwa Hur , Stefan Roth

This paper proposes an end-to-end trainable network, SegFlow, for simultaneously predicting pixel-wise object segmentation and optical flow in videos. The proposed SegFlow has two branches where useful information of object segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-21 Jingchun Cheng , Yi-Hsuan Tsai , Shengjin Wang , Ming-Hsuan Yang

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

This paper presents a novel architecture for simultaneous estimation of highly accurate optical flows and rigid scene transformations for difficult scenarios where the brightness assumption is violated by strong shading changes. In the case…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Torben Fetzer , Gerd Reis , Didier Stricker

The matching function for the problem of stereo reconstruction or optical flow has been traditionally designed as a function of the distance between the features describing matched pixels. This approach works under assumption, that the…

Computer Vision and Pattern Recognition · Computer Science 2015-02-04 Ľubor Ladický , Christian Häne , Marc Pollefeys

Two optical flow estimation problems are addressed: i) occlusion estimation and handling, and ii) estimation from image sequences longer than two frames. The proposed ContinualFlow method estimates occlusions before flow, avoiding the use…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Michal Neoral , Jan Šochman , Jiří Matas