English
Related papers

Related papers: GenOpticalFlow: A Generative Approach to Unsupervi…

200 papers

We propose a novel data augmentation approach, DistractFlow, for training optical flow estimation models by introducing realistic distractions to the input frames. Based on a mixing ratio, we combine one of the frames in the pair with a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jisoo Jeong , Hong Cai , Risheek Garrepalli , Fatih Porikli

We study the unsupervised learning of CNNs for optical flow estimation using proxy ground truth data. Supervised CNNs, due to their immense learning capacity, have shown superior performance on a range of computer vision problems including…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yi Zhu , Zhenzhong Lan , Shawn Newsam , Alexander G. Hauptmann

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Nikolaus Mayer , Eddy Ilg , Philipp Fischer , Caner Hazirbas , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chanuka Algama , Kasun Amarasinghe

Despite the significant progress that has been made on estimating optical flow recently, most estimation methods, including classical and deep learning approaches, still have difficulty with multi-scale estimation, real-time computation,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Yi Zhu , Shawn Newsam

Recent works have shown that optical flow can be learned by deep networks from unlabelled image pairs based on brightness constancy assumption and smoothness prior. Current approaches additionally impose an augmentation regularization term…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jie Yang

Due to the scarcity of annotated scene flow data, self-supervised scene flow learning in point clouds has attracted increasing attention. In the self-supervised manner, establishing correspondences between two point clouds to approximate…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Ruibo Li , Guosheng Lin , Lihua Xie

In recent years, the LiDAR images, as a 2D compact representation of 3D LiDAR point clouds, are widely applied in various tasks, e.g., 3D semantic segmentation, LiDAR point cloud compression (PCC). Among these works, the optical flow…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Xuezhou Guo , Xuhu Lin , Lili Zhao , Zezhi Zhu , Jianwen Chen

Occlusions between consecutive frames have long posed a significant challenge in optical flow estimation. The inherent ambiguity introduced by occlusions directly violates the brightness constancy constraint and considerably hinders…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shangkun Sun , Jiaming Liu , Thomas H. Li , Huaxia Li , Guoqing Liu , Wei Gao

Inaccurate optical flow estimates in and near occluded regions, and out-of-boundary regions are two of the current significant limitations of optical flow estimation algorithms. Recent state-of-the-art optical flow estimation algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Fisseha Admasu Ferede , Madhusudhanan Balasubramanian

Event cameras hold significant promise for high-temporal-resolution (HTR) motion estimation. However, estimating event-based HTR optical flow faces two key challenges: the absence of HTR ground-truth data and the intrinsic sparsity of event…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Qianang Zhou , Zhiyu Zhu , Junhui Hou , Yongjian Deng , Youfu Li , Junlin Xiong

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

Accurate estimation of large displacement optical flow remains a critical challenge. Existing methods typically rely on iterative local search or/and domain-specific fine-tuning, which severely limits their performance in large displacement…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Dingxi Zhang , Fangjinhua Wang , Marc Pollefeys , Haofei Xu

Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Ali K. Z. Tehrani , Morteza Mirzaei , Hassan Rivaz

The occlusion problem remains a crucial challenge in optical flow estimation (OFE). Despite the recent significant progress brought about by deep learning, most existing deep learning OFE methods still struggle to handle occlusions; in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Bo Wang , Yifan Zhang , Jian Li , Yang Yu , Zhenping Sun , Li Liu , Dewen Hu

The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on data augmentation, they have yet to fully exploit the rich…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jisoo Jeong , Hong Cai , Risheek Garrepalli , Jamie Menjay Lin , Munawar Hayat , Fatih Porikli

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

Machine Learning · Computer Science 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

In this paper, we proposed an unsupervised learning method for estimating the optical flow between video frames, especially to solve the occlusion problem. Occlusion is caused by the movement of an object or the movement of the camera,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Jianfeng Li , Junqiao Zhao , Tiantian Feng , Chen Ye , Lu Xiong

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

The accuracy of learning-based optical flow estimation models heavily relies on the realism of the training datasets. Current approaches for generating such datasets either employ synthetic data or generate images with limited realism.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yingping Liang , Jiaming Liu , Debing Zhang , Ying Fu