English

SSL-Interactions: Pretext Tasks for Interactive Trajectory Prediction

Computer Vision and Pattern Recognition 2024-08-27 v2 Artificial Intelligence Robotics

Abstract

This paper addresses motion forecasting in multi-agent environments, pivotal for ensuring safety of autonomous vehicles. Traditional as well as recent data-driven marginal trajectory prediction methods struggle to properly learn non-linear agent-to-agent interactions. We present SSL-Interactions that proposes pretext tasks to enhance interaction modeling for trajectory prediction. We introduce four interaction-aware pretext tasks to encapsulate various aspects of agent interactions: range gap prediction, closest distance prediction, direction of movement prediction, and type of interaction prediction. We further propose an approach to curate interaction-heavy scenarios from datasets. This curated data has two advantages: it provides a stronger learning signal to the interaction model, and facilitates generation of pseudo-labels for interaction-centric pretext tasks. We also propose three new metrics specifically designed to evaluate predictions in interactive scenes. Our empirical evaluations indicate SSL-Interactions outperforms state-of-the-art motion forecasting methods quantitatively with up to 8% improvement, and qualitatively, for interaction-heavy scenarios.

Keywords

Cite

@article{arxiv.2401.07729,
  title  = {SSL-Interactions: Pretext Tasks for Interactive Trajectory Prediction},
  author = {Prarthana Bhattacharyya and Chengjie Huang and Krzysztof Czarnecki},
  journal= {arXiv preprint arXiv:2401.07729},
  year   = {2024}
}

Comments

Accepted at IV-2024. 13 pages, 5 figures

R2 v1 2026-06-28T14:17:07.386Z