Towards Anytime Optical Flow Estimation with Event Cameras
Abstract
Event cameras respond to changes in log-brightness at the millisecond level, making them ideal for optical flow estimation. However, existing datasets from event cameras provide only low frame rate ground truth for optical flow, limiting the research potential of event-driven optical flow. To address this challenge, we introduce a low-latency event representation, Unified Voxel Grid, and propose EVA-Flow, an EVent-based Anytime Flow estimation network to produce high-frame-rate event optical flow with only low-frame-rate optical flow ground truth for supervision. Furthermore, we propose the Rectified Flow Warp Loss (RFWL) for the unsupervised assessment of intermediate optical flow. A comprehensive variety of experiments on MVSEC, DESC, and our EVA-FlowSet demonstrates that EVA-Flow achieves competitive performance, super-low-latency (5ms), time-dense motion estimation (200Hz), and strong generalization. Our code will be available at https://github.com/Yaozhuwa/EVA-Flow.
Keywords
Cite
@article{arxiv.2307.05033,
title = {Towards Anytime Optical Flow Estimation with Event Cameras},
author = {Yaozu Ye and Hao Shi and Kailun Yang and Ze Wang and Xiaoting Yin and Lei Sun and Yaonan Wang and Kaiwei Wang},
journal= {arXiv preprint arXiv:2307.05033},
year = {2025}
}
Comments
Accepted to Sensors. Our code will be available at https://github.com/Yaozhuwa/EVA-Flow