English

TripCast: Pre-training of Masked 2D Transformers for Trip Time Series Forecasting

Machine Learning 2024-10-25 v1 Artificial Intelligence

Abstract

Deep learning and pre-trained models have shown great success in time series forecasting. However, in the tourism industry, time series data often exhibit a leading time property, presenting a 2D structure. This introduces unique challenges for forecasting in this sector. In this study, we propose a novel modelling paradigm, TripCast, which treats trip time series as 2D data and learns representations through masking and reconstruction processes. Pre-trained on large-scale real-world data, TripCast notably outperforms other state-of-the-art baselines in in-domain forecasting scenarios and demonstrates strong scalability and transferability in out-domain forecasting scenarios.

Keywords

Cite

@article{arxiv.2410.18612,
  title  = {TripCast: Pre-training of Masked 2D Transformers for Trip Time Series Forecasting},
  author = {Yuhua Liao and Zetian Wang and Peng Wei and Qiangqiang Nie and Zhenhua Zhang},
  journal= {arXiv preprint arXiv:2410.18612},
  year   = {2024}
}

Comments

Accepted by ICONIP 2024