English

Multimodal Trajectory Representation Learning for Travel Time Estimation

Machine Learning 2026-01-27 v2

Abstract

Accurate travel time estimation (TTE) plays a crucial role in intelligent transportation systems. However, it remains challenging due to heterogeneous data sources and complex traffic dynamics. Moreover, traditional approaches typically convert trajectory data into fixed-length representations. This overlooks the inherent variability of real-world motion patterns, often resulting in information loss and redundancy. To address these challenges, this paper introduces the Multimodal Dynamic Trajectory Integration (MDTI) framework--a novel multimodal trajectory representation learning approach that integrates GPS sequences, grid trajectories, and road network constraints to enhance the performance of TTE. MDTI employs modality-specific encoders and a multimodal fusion module to capture complementary spatial, temporal, and topological semantics, while a dynamic trajectory modeling mechanism adaptively regulates information density for trajectories of varying lengths. Two self-supervised pretraining objectives, named contrastive alignment and masked language modeling, further strengthen multimodal consistency and contextual understanding. Extensive experiments on three real-world datasets demonstrate that MDTI consistently outperforms state-of-the-art baselines, confirming its robustness and strong generalization abilities. The code is publicly available at: https://github.com/City-Computing/MDTI.

Keywords

Cite

@article{arxiv.2510.05840,
  title  = {Multimodal Trajectory Representation Learning for Travel Time Estimation},
  author = {Zhi Liu and Xuyuan Hu and Xiao Han and Zhehao Dai and Zhaolin Deng and Guojiang Shen and Xiangjie Kong},
  journal= {arXiv preprint arXiv:2510.05840},
  year   = {2026}
}
R2 v1 2026-07-01T06:21:12.661Z