中文
相关论文

相关论文: SelFlow: Self-Supervised Learning of Optical Flow

200 篇论文

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

In this work, we propose a novel framework for unsupervised learning for event cameras that learns motion information from only the event stream. In particular, we propose an input representation of the events in the form of a discretized…

计算机视觉与模式识别 · 计算机科学 2018-12-20 Alex Zihao Zhu , Liangzhe Yuan , Kenneth Chaney , Kostas Daniilidis

Estimating per-pixel motion between video frames, known as optical flow, is a long-standing problem in video understanding and analysis. Most contemporary optical flow techniques largely focus on addressing the cross-image matching with…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Ao Luo , Fan Yang , Kunming Luo , Xin Li , Haoqiang Fan , Shuaicheng Liu

Existing recurrent optical flow estimation networks are computationally expensive since they use a fixed large number of iterations to update the flow field for each sample. An efficient network should skip iterations when the flow…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Ri Cheng , Ruian He , Xuhao Jiang , Shili Zhou , Weimin Tan , Bo Yan

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

Optical flow estimation is one of the fundamental tasks in low-level computer vision, which describes the pixel-wise displacement and can be used in many other tasks. From the apparent aspect, the optical flow can be viewed as the…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Yuhao Cheng , Siru Zhang , Yiqiang Yan

Optical flow estimation is a fundamental and long-standing visual task. In this work, we present a novel method, dubbed HMAFlow, to improve optical flow estimation in challenging scenes, particularly those involving small objects. The…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Dianbo Ma , Kousuke Imamura , Ziyan Gao , Xiangjie Wang , Satoshi Yamane

We propose a novel approach for optical flow estimation , targeted at large displacements with significant oc-clusions. It consists of two steps: i) dense matching by edge-preserving interpolation from a sparse set of matches; ii)…

计算机视觉与模式识别 · 计算机科学 2015-05-20 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

计算机视觉与模式识别 · 计算机科学 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

计算机视觉与模式识别 · 计算机科学 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Estimating continuous optical flow is a fundamental yet challenging problem in dynamic visual perception. Event-based cameras, with microsecond latency and high dynamic range, capture brightness changes asynchronously, offering a unique…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Rui Hu , Song Wu , Wen Yang , Jinjian Wu

Learning scene flow from a monocular camera still remains a challenging task due to its ill-posedness as well as lack of annotated data. Self-supervised methods demonstrate learning scene flow estimation from unlabeled data, yet their…

计算机视觉与模式识别 · 计算机科学 2022-05-04 Bayram Bayramli , Junhwa Hur , Hongtao Lu

Optical flow estimation is a basic task in self-driving and robotics systems, which enables to temporally interpret traffic scenes. Autonomous vehicles clearly benefit from the ultra-wide Field of View (FoV) offered by 360{\deg} panoramic…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Hao Shi , Yifan Zhou , Kailun Yang , Xiaoting Yin , Ze Wang , Yaozu Ye , Zhe Yin , Shi Meng , Peng Li , Kaiwei Wang

Unsupervised optical flow estimators based on deep learning have attracted increasing attention due to the cost and difficulty of annotating for ground truth. Although performance measured by average End-Point Error (EPE) has improved over…

计算机视觉与模式识别 · 计算机科学 2022-08-05 Shuzhi Yu , Hannah Halin Kim , Shuai Yuan , Carlo Tomasi

The convolutional neural network model for optical flow estimation usually outputs a low-resolution(LR) optical flow field. To obtain the corresponding full image resolution,interpolation and variational approach are the most common…

计算机视觉与模式识别 · 计算机科学 2018-09-05 Liping Zhang , Zongqing Lu , Qingmin Liao

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

In the domain of computer vision, optical flow stands as a cornerstone for unraveling dynamic visual scenes. However, the challenge of accurately estimating optical flow under conditions of large nonlinear motion patterns remains an open…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Chanuka Algama , Kasun Amarasinghe

This paper proposes a framework to guide an optical flow network with external cues to achieve superior accuracy either on known or unseen domains. Given the availability of sparse yet accurate optical flow hints from an external source,…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Matteo Poggi , Filippo Aleotti , Stefano Mattoccia

Optical flow estimation is an essential step for many real-world computer vision tasks. Existing deep networks have achieved satisfactory results by mostly employing a pyramidal coarse-to-fine paradigm, where a key process is to adopt…

计算机视觉与模式识别 · 计算机科学 2021-02-02 Lingtong Kong , Xiaohang Yang , Jie Yang

Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can…

图像与视频处理 · 电气工程与系统科学 2020-07-06 Ali K. Z. Tehrani , Morteza Mirzaei , Hassan Rivaz