English

Spatiotemporal Tile-based Attention-guided LSTMs for Traffic Video Prediction

Computer Vision and Pattern Recognition 2025-10-09 v4 Machine Learning Image and Video Processing

Abstract

This extended abstract describes our solution for the Traffic4Cast Challenge 2019. The task requires modeling both fine-grained (pixel-level) and coarse (region-level) spatial structure while preserving temporal relationships across long sequences. Building on Conv-LSTM ideas, we introduce a tile-aware, cascaded-memory Conv-LSTM augmented with cross-frame additive attention and a memory-flexible training scheme: frames are sampled per spatial tile so the model learns tile-local dynamics and per-tile memory cells can be updated sparsely, paged, or compressed to scale to large maps. We provide a compact theoretical analysis (tight softmax/attention Lipschitz bound and a tiling error lower bound) explaining stability and the memory-accuracy tradeoffs, and empirically demonstrate improved scalability and competitive forecasting performance on large-scale traffic heatmaps.

Keywords

Cite

@article{arxiv.1910.11030,
  title  = {Spatiotemporal Tile-based Attention-guided LSTMs for Traffic Video Prediction},
  author = {Tu Nguyen},
  journal= {arXiv preprint arXiv:1910.11030},
  year   = {2025}
}

Comments

Neurips 2019 Traffic4Cast Challenge, v4: added formal proofs

R2 v1 2026-06-23T11:53:33.550Z