English

LMFormer: Lane based Motion Prediction Transformer

Computer Vision and Pattern Recognition 2025-04-15 v1 Machine Learning

Abstract

Motion prediction plays an important role in autonomous driving. This study presents LMFormer, a lane-aware transformer network for trajectory prediction tasks. In contrast to previous studies, our work provides a simple mechanism to dynamically prioritize the lanes and shows that such a mechanism introduces explainability into the learning behavior of the network. Additionally, LMFormer uses the lane connection information at intersections, lane merges, and lane splits, in order to learn long-range dependency in lane structure. Moreover, we also address the issue of refining the predicted trajectories and propose an efficient method for iterative refinement through stacked transformer layers. For benchmarking, we evaluate LMFormer on the nuScenes dataset and demonstrate that it achieves SOTA performance across multiple metrics. Furthermore, the Deep Scenario dataset is used to not only illustrate cross-dataset network performance but also the unification capabilities of LMFormer to train on multiple datasets and achieve better performance.

Keywords

Cite

@article{arxiv.2504.10275,
  title  = {LMFormer: Lane based Motion Prediction Transformer},
  author = {Harsh Yadav and Maximilian Schaefer and Kun Zhao and Tobias Meisen},
  journal= {arXiv preprint arXiv:2504.10275},
  year   = {2025}
}

Comments

Accepted: Autonomous Driving Workshop, CVPR 2025

R2 v1 2026-06-28T22:57:44.550Z