English

Vision-based Perception System for Automated Delivery Robot-Pedestrians Interactions

Robotics 2025-08-06 v1 Machine Learning

Abstract

The integration of Automated Delivery Robots (ADRs) into pedestrian-heavy urban spaces introduces unique challenges in terms of safe, efficient, and socially acceptable navigation. We develop the complete pipeline for a single vision sensor based multi-pedestrian detection and tracking, pose estimation, and monocular depth perception. Leveraging the real-world MOT17 dataset sequences, this study demonstrates how integrating human-pose estimation and depth cues enhances pedestrian trajectory prediction and identity maintenance, even under occlusions and dense crowds. Results show measurable improvements, including up to a 10% increase in identity preservation (IDF1), a 7% improvement in multiobject tracking accuracy (MOTA), and consistently high detection precision exceeding 85%, even in challenging scenarios. Notably, the system identifies vulnerable pedestrian groups supporting more socially aware and inclusive robot behaviour.

Keywords

Cite

@article{arxiv.2508.03541,
  title  = {Vision-based Perception System for Automated Delivery Robot-Pedestrians Interactions},
  author = {Ergi Tushe and Bilal Farooq},
  journal= {arXiv preprint arXiv:2508.03541},
  year   = {2025}
}
R2 v1 2026-07-01T04:35:21.539Z