Event-based vision has already revolutionized the perception task for robots by promising faster response, lower energy consumption, and lower bandwidth without introducing motion blur. In this work, a novel deep learning method based on gated recurrent units utilizing sparse convolutions for detecting gates in a race track is proposed using event-based vision for the autonomous drone racing problem. We demonstrate the efficiency and efficacy of the perception pipeline on a real robot platform that can safely navigate a typical autonomous drone racing track in real-time. Throughout the experiments, we show that the event-based vision with the proposed gated recurrent unit and pretrained models on simulated event data significantly improve the gate detection precision. Furthermore, an event-based drone racing dataset consisting of both simulated and real data sequences is publicly released.
@article{arxiv.2204.02120,
title = {Event-based Navigation for Autonomous Drone Racing with Sparse Gated Recurrent Network},
author = {Kristoffer Fogh Andersen and Huy Xuan Pham and Halil Ibrahim Ugurlu and Erdal Kayacan},
journal= {arXiv preprint arXiv:2204.02120},
year = {2022}
}
Comments
Accepted to present at the 20th European Control Conference (ECC)