English
Related papers

Related papers: MemFlow: Optical Flow Estimation and Prediction wi…

200 papers

We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out moving objects from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Tatsunori Taniai , Sudipta N. Sinha , Yoichi Sato

Optical flow is a fundamental technique for motion estimation, widely applied in video stabilization, interpolation, and object tracking. Traditional optical flow estimation methods rely on restrictive assumptions like brightness constancy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yu-Hsi Chen , Chin-Tien Wu

Existing video prediction methods mainly rely on observing multiple historical frames or focus on predicting the next one-frame. In this work, we study the problem of generating consecutive multiple future frames by observing one single…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

Scene flow estimation, which extracts point-wise motion between scenes, is becoming a crucial task in many computer vision tasks. However, all of the existing estimation methods utilize only the unidirectional features, restricting the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Wencan Cheng , Jong Hwan Ko

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

Key-point-based scene understanding is fundamental for autonomous driving applications. At the same time, optical flow plays an important role in many vision tasks. However, due to the implicit bias of equal attention on all points, classic…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Zhonghua Yi , Hao Shi , Kailun Yang , Qi Jiang , Yaozu Ye , Ze Wang , Huajian Ni , Kaiwei Wang

To apply optical flow in practice, it is often necessary to resize the input to smaller dimensions in order to reduce computational costs. However, downsizing inputs makes the estimation more challenging because objects and motion ranges…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Hyunyoung Jung , Zhuo Hui , Lei Luo , Haitao Yang , Feng Liu , Sungjoo Yoo , Rakesh Ranjan , Denis Demandolx

Multi-step prediction models, such as diffusion and rectified flow models, have emerged as state-of-the-art solutions for generation tasks. However, these models exhibit higher latency in sampling new frames compared to single-step methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Gaurav Shrivastava , Abhinav Shrivastava

Optical flow estimation is one of the most studied problems in computer vision, yet recent benchmark datasets continue to reveal problem areas of today's approaches. Occlusions have remained one of the key challenges. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Junhwa Hur , Stefan Roth

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

Obtaining the ground truth labels from a video is challenging since the manual annotation of pixel-wise flow labels is prohibitively expensive and laborious. Besides, existing approaches try to adapt the trained model on synthetic datasets…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yunhui Han , Kunming Luo , Ao Luo , Jiangyu Liu , Haoqiang Fan , Guiming Luo , Shuaicheng Liu

Accurate fall detection for the assistance of older people is crucial to reduce incidents of deaths or injuries due to falls. Meanwhile, a vision-based fall detection system has shown some significant results to detect falls. Still,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Sagar Chhetri , Abeer Alsadoon , Thair Al Dala in , P. W. C. Prasad , Tarik A. Rashid , Angelika Maag

Event-based motion field estimation is an important task. However, current optical flow methods face challenges: learning-based approaches, often frame-based and relying on CNNs, lack cross-domain transferability, while model-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Dehao Yuan , Levi Burner , Jiayi Wu , Minghui Liu , Jingxi Chen , Yiannis Aloimonos , Cornelia Fermüller

Event cameras hold significant promise for high-temporal-resolution (HTR) motion estimation. However, estimating event-based HTR optical flow faces two key challenges: the absence of HTR ground-truth data and the intrinsic sparsity of event…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Qianang Zhou , Zhiyu Zhu , Junhui Hou , Yongjian Deng , Youfu Li , Junlin Xiong

Optical flow estimation is a classical yet challenging task in computer vision. One of the essential factors in accurately predicting optical flow is to alleviate occlusions between frames. However, it is still a thorny problem for current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shangkun Sun , Yuanqi Chen , Yu Zhu , Guodong Guo , Ge Li

Real-time motion detection in non-stationary scenes is a difficult task due to dynamic background, changing foreground appearance and limited computational resource. These challenges degrade the performance of the existing methods in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Junjie Huang , Wei Zou , Zheng Zhu , Jiagang Zhu

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

Recently, neural network for scene flow estimation show impressive results on automotive data such as the KITTI benchmark. However, despite of using sophisticated rigidity assumptions and parametrizations, such networks are typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Lukas Mehl , Azin Jahedi , Jenny Schmalfuss , Andrés Bruhn

Gathering data and identifying events in various traffic situations remains an essential challenge for the systematic evaluation of a perception system's performance. Analyzing large-scale, typically unstructured, multi-modal, time series…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Tayssir Bouraffa , Elias Kjellberg Carlson , Erik Wessman , Ali Nouri , Pierre Lamart , Christian Berger

Scene flow is a description of real world motion in 3D that contains more information than optical flow. Because of its complexity there exists no applicable variant for real-time scene flow estimation in an automotive or commercial vehicle…

Computer Vision and Pattern Recognition · Computer Science 2018-06-22 René Schuster , Christian Bailer , Oliver Wasenmüller , Didier Stricker