English

Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesis

Computer Vision and Pattern Recognition 2021-03-23 v2

Abstract

Multimodal prediction results are essential for trajectory prediction task as there is no single correct answer for the future. Previous frameworks can be divided into three categories: regression, generation and classification frameworks. However, these frameworks have weaknesses in different aspects so that they cannot model the multimodal prediction task comprehensively. In this paper, we present a novel insight along with a brand-new prediction framework by formulating multimodal prediction into three steps: modality clustering, classification and synthesis, and address the shortcomings of earlier frameworks. Exhaustive experiments on popular benchmarks have demonstrated that our proposed method surpasses state-of-the-art works even without introducing social and map information. Specifically, we achieve 19.2% and 20.8% improvement on ADE and FDE respectively on ETH/UCY dataset. Our code will be made publicly availabe.

Keywords

Cite

@article{arxiv.2103.07854,
  title  = {Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesis},
  author = {Jianhua Sun and Yuxuan Li and Hao-Shu Fang and Cewu Lu},
  journal= {arXiv preprint arXiv:2103.07854},
  year   = {2021}
}
R2 v1 2026-06-24T00:07:14.184Z