English

Multi-agent Trajectory Prediction with Fuzzy Query Attention

Machine Learning 2020-11-02 v1 Computer Vision and Pattern Recognition

Abstract

Trajectory prediction for scenes with multiple agents and entities is a challenging problem in numerous domains such as traffic prediction, pedestrian tracking and path planning. We present a general architecture to address this challenge which models the crucial inductive biases of motion, namely, inertia, relative motion, intents and interactions. Specifically, we propose a relational model to flexibly model interactions between agents in diverse environments. Since it is well-known that human decision making is fuzzy by nature, at the core of our model lies a novel attention mechanism which models interactions by making continuous-valued (fuzzy) decisions and learning the corresponding responses. Our architecture demonstrates significant performance gains over existing state-of-the-art predictive models in diverse domains such as human crowd trajectories, US freeway traffic, NBA sports data and physics datasets. We also present ablations and augmentations to understand the decision-making process and the source of gains in our model.

Keywords

Cite

@article{arxiv.2010.15891,
  title  = {Multi-agent Trajectory Prediction with Fuzzy Query Attention},
  author = {Nitin Kamra and Hao Zhu and Dweep Trivedi and Ming Zhang and Yan Liu},
  journal= {arXiv preprint arXiv:2010.15891},
  year   = {2020}
}

Comments

NeurIPS 2020 Camera-ready version. Code: https://github.com/nitinkamra1992/FQA

R2 v1 2026-06-23T19:45:34.676Z