English

RST-MODNet: Real-time Spatio-temporal Moving Object Detection for Autonomous Driving

Computer Vision and Pattern Recognition 2019-12-03 v1 Machine Learning Robotics Machine Learning

Abstract

Moving Object Detection (MOD) is a critical task for autonomous vehicles as moving objects represent higher collision risk than static ones. The trajectory of the ego-vehicle is planned based on the future states of detected moving objects. It is quite challenging as the ego-motion has to be modelled and compensated to be able to understand the motion of the surrounding objects. In this work, we propose a real-time end-to-end CNN architecture for MOD utilizing spatio-temporal context to improve robustness. We construct a novel time-aware architecture exploiting temporal motion information embedded within sequential images in addition to explicit motion maps using optical flow images.We demonstrate the impact of our algorithm on KITTI dataset where we obtain an improvement of 8% relative to the baselines. We compare our algorithm with state-of-the-art methods and achieve competitive results on KITTI-Motion dataset in terms of accuracy at three times better run-time. The proposed algorithm runs at 23 fps on a standard desktop GPU targeting deployment on embedded platforms.

Keywords

Cite

@article{arxiv.1912.00438,
  title  = {RST-MODNet: Real-time Spatio-temporal Moving Object Detection for Autonomous Driving},
  author = {Mohamed Ramzy and Hazem Rashed and Ahmad El Sallab and Senthil Yogamani},
  journal= {arXiv preprint arXiv:1912.00438},
  year   = {2019}
}

Comments

Accepted for presentation at NeurIPS 2019 Workshop on Machine Learning for Autonomous Driving

R2 v1 2026-06-23T12:32:23.457Z