English

Pedestrian Models for Autonomous Driving Part I: Low-Level Models, from Sensing to Tracking

Computer Vision and Pattern Recognition 2020-08-12 v2 Machine Learning Robotics

Abstract

Autonomous vehicles (AVs) must share space with pedestrians, both in carriageway cases such as cars at pedestrian crossings and off-carriageway cases such as delivery vehicles navigating through crowds on pedestrianized high-streets. Unlike static obstacles, pedestrians are active agents with complex, interactive motions. Planning AV actions in the presence of pedestrians thus requires modelling of their probable future behaviour as well as detecting and tracking them. This narrative review article is Part I of a pair, together surveying the current technology stack involved in this process, organising recent research into a hierarchical taxonomy ranging from low-level image detection to high-level psychology models, from the perspective of an AV designer. This self-contained Part I covers the lower levels of this stack, from sensing, through detection and recognition, up to tracking of pedestrians. Technologies at these levels are found to be mature and available as foundations for use in high-level systems, such as behaviour modelling, prediction and interaction control.

Keywords

Cite

@article{arxiv.2002.11669,
  title  = {Pedestrian Models for Autonomous Driving Part I: Low-Level Models, from Sensing to Tracking},
  author = {Fanta Camara and Nicola Bellotto and Serhan Cosar and Dimitris Nathanael and Matthias Althoff and Jingyuan Wu and Johannes Ruenz and André Dietrich and Charles W. Fox},
  journal= {arXiv preprint arXiv:2002.11669},
  year   = {2020}
}

Comments

Accepted for publication in the IEEE Transactions on Intelligent Transportation Systems

R2 v1 2026-06-23T13:54:59.012Z