English
Related papers

Related papers: E-RAFT: Dense Optical Flow from Event Cameras

200 papers

Event cameras are bio-inspired sensors that perform well in challenging illumination conditions and have high temporal resolution. However, their concept is fundamentally different from traditional frame-based cameras. The pixels of an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Xin Peng , Ling Gao , Yifu Wang , Laurent Kneip

Event cameras have the ability to record continuous and detailed trajectories of objects with high temporal resolution, thereby providing intuitive motion cues for optical flow estimation. Nevertheless, most existing learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Haotian Liu , Guang Chen , Sanqing Qu , Yanping Zhang , Zhijun Li , Alois Knoll , Changjun Jiang

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

We introduce a novel matching algorithm, called DeepMatching, to compute dense correspondences between images. DeepMatching relies on a hierarchical, multi-layer, correlational architecture designed for matching images and was inspired by…

Computer Vision and Pattern Recognition · Computer Science 2015-10-12 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

The performance of optical flow algorithms greatly depends on the specifics of the content and the application for which it is used. Existing and well established optical flow datasets are limited to rather particular contents from which…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Gregory Schröder , Tobias Senst , Erik Bochinski , Thomas Sikora

Event cameras are a kind of bio-inspired sensors that generate data when the brightness changes, which are of low-latency and high dynamic range (HDR). However, due to the nature of the sparse event stream, event-based mapping can only…

Robotics · Computer Science 2021-06-04 Yan Dong

Recent optical flow estimation methods often employ local cost sampling from a dense all-pairs correlation volume. This results in quadratic computational and memory complexity in the number of pixels. Although an alternative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Karlis Martins Briedis , Markus Gross , Christopher Schroers

Inspired by frame-based methods, state-of-the-art event-based optical flow networks rely on the explicit construction of correlation volumes, which are expensive to compute and store, rendering them unsuitable for robotic applications with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yilun Wu , Federico Paredes-Vallés , Guido C. H. E. de Croon

We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out moving objects from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Tatsunori Taniai , Sudipta N. Sinha , Yoichi Sato

As a bio-inspired sensor with high temporal resolution, the spiking camera has an enormous potential in real applications, especially for motion estimation in high-speed scenes. However, frame-based and event-based methods are not well…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Liwen Hu , Rui Zhao , Ziluo Ding , Lei Ma , Boxin Shi , Ruiqin Xiong , Tiejun Huang

Optical flow estimation is a fundamental and long-standing visual task. In this work, we present a novel method, dubbed HMAFlow, to improve optical flow estimation in challenging scenes, particularly those involving small objects. The…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Dianbo Ma , Kousuke Imamura , Ziyan Gao , Xiangjie Wang , Satoshi Yamane

Point clouds are naturally sparse, while image pixels are dense. The inconsistency limits feature fusion from both modalities for point-wise scene flow estimation. Previous methods rarely predict scene flow from the entire point clouds of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Chensheng Peng , Guangming Wang , Xian Wan Lo , Xinrui Wu , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Optical flow is a classical task that is important to the vision community. Classical optical flow estimation uses two frames as input, whilst some recent methods consider multiple frames to explicitly model long-range information. The…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qiaole Dong , Yanwei Fu

In most of computer vision applications, motion blur is regarded as an undesirable artifact. However, it has been shown that motion blur in an image may have practical interests in fundamental computer vision problems. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dawit Mureja Argaw , Junsik Kim , Francois Rameau , Jae Won Cho , In So Kweon

Event cameras provide high temporal precision, low data rates, and high dynamic range visual perception, which are well-suited for optical flow estimation. While data-driven optical flow estimation has obtained great success in RGB cameras,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yijin Li , Zhaoyang Huang , Shuo Chen , Xiaoyu Shi , Hongsheng Li , Hujun Bao , Zhaopeng Cui , Guofeng Zhang

Depth map estimation is a crucial task in computer vision, and new approaches have recently emerged taking advantage of light fields, as this new imaging modality captures much more information about the angular direction of light rays…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Yang Chen , Martin Alain , Aljosa Smolic

Optical flow estimation is a well-studied topic for automated driving applications. Many outstanding optical flow estimation methods have been proposed, but they become erroneous when tested in challenging scenarios that are commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Shihao Shen , Louis Kerofsky , Senthil Yogamani

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley

Event cameras are bio-inspired sensors that perform well in HDR conditions and have high temporal resolution. However, different from traditional frame-based cameras, event cameras measure asynchronous pixel-level brightness changes and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Xin Peng , Yifu Wang , Ling Gao , Laurent Kneip