English
Related papers

Related papers: ProSTformer: Pre-trained Progressive Space-Time Se…

200 papers

Traffic forecasting is a cornerstone of smart city management, enabling efficient resource allocation and transportation planning. Deep learning, with its ability to capture complex nonlinear patterns in spatiotemporal (ST) data, has…

Machine Learning · Computer Science 2024-10-16 Hongjun Wang , Jiyuan Chen , Tong Pan , Zheng Dong , Lingyu Zhang , Renhe Jiang , Xuan Song

Autonomous navigation in marine environments can be extremely challenging, especially in the presence of spatially varying flow disturbances and dynamic and static obstacles. In this work, we demonstrate that incorporating local flow field…

Robotics · Computer Science 2025-07-11 Ehsan Kazemi , Dechen Gao , Iman Soltani

Transformers based on the attention mechanism have achieved impressive success in various areas. However, the attention mechanism has a quadratic complexity, significantly impeding Transformers from dealing with numerous tokens and scaling…

Machine Learning · Computer Science 2022-06-17 Haixu Wu , Jialong Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long

Spatiotemporal forecasting of traffic flow data represents a typical problem in the field of machine learning, impacting urban traffic management systems. In general, spatiotemporal forecasting problems involve complex interactions,…

Machine Learning · Computer Science 2025-02-18 Yash Jakhmola , Madhurima Panja , Nitish Kumar Mishra , Kripabandhu Ghosh , Uttam Kumar , Tanujit Chakraborty

The rapid growth of private car ownership has worsened the urban parking predicament, underscoring the need for accurate and effective parking availability prediction to support urban planning and management. To address key limitations in…

Machine Learning · Computer Science 2025-09-05 Yin Huang , Yongqi Dong , Youhua Tang , Li Li

Self-attention has recently been adopted for a wide range of sequence modeling problems. Despite its effectiveness, self-attention suffers from quadratic compute and memory requirements with respect to sequence length. Successful approaches…

Machine Learning · Computer Science 2020-10-27 Aurko Roy , Mohammad Saffar , Ashish Vaswani , David Grangier

In an intelligent transportation system, the key problem of traffic forecasting is how to extract periodic temporal dependencies and complex spatial correlations. Current state-of-the-art methods for predicting traffic flow are based on…

Machine Learning · Computer Science 2022-03-01 Zichuan Liu , Rui Zhang , Chen Wang , Zhu Xiao , Hongbo Jiang

We study the forecasting problem for traffic with dynamic, possibly periodical, and joint spatial-temporal dependency between regions. Given the aggregated inflow and outflow traffic of regions in a city from time slots 0 to t-1, we predict…

Machine Learning · Computer Science 2022-05-05 Guanyao Li , Shuhan Zhong , S. -H. Gary Chan , Ruiyuan Li , Chih-Chieh Hung , Wen-Chih Peng

Origin-Destination (OD) matrices record directional flow data between pairs of OD regions. The intricate spatiotemporal dependency in the matrices makes the OD matrix forecasting (ODMF) problem not only intractable but also non-trivial.…

Artificial Intelligence · Computer Science 2022-08-18 Jin Huang , Bosong Huang , Weihao Yu , Jing Xiao , Ruzhong Xie , Ke Ruan

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. While…

Machine Learning · Computer Science 2025-11-18 Tao Zou , Chengfeng Wu , Tianxi Liao , Junchen Ye , Bowen Du

Accurate, and effective traffic forecasting is vital for smart traffic systems, crucial in urban traffic planning and management. Current Spatio-Temporal Transformer models, despite their prediction capabilities, struggle with balancing…

Machine Learning · Computer Science 2026-01-29 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Xusheng Yao , Junbin Gao

A robust awareness of how dynamic scenes evolve is essential for Autonomous Driving systems, as they must accurately detect, track, and predict the behaviour of surrounding obstacles. Traditional perception pipelines that rely on modular…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Miguel Antunes-García , Santiago Montiel-Marín , Fabio Sánchez-García , Rodrigo Gutiérrez-Moreno , Rafael Barea , Luis M. Bergasa

Accurate traffic forecasting is essential for intelligent transportation systems, supporting a wide range of real-world applications. However, it remains challenging due to two key factors:~(1) Traffic series contain heterogeneous temporal…

Artificial Intelligence · Computer Science 2026-05-26 Ruiwen Gu , Qitai Tan , Yahao Liu , Xiao-Ping Zhang

Motion forecasting for autonomous driving is a challenging task because complex driving scenarios result in a heterogeneous mix of static and dynamic inputs. It is an open problem how best to represent and fuse information about road…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Nigamaa Nayakanti , Rami Al-Rfou , Aurick Zhou , Kratarth Goel , Khaled S. Refaat , Benjamin Sapp

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

Long-term traffic prediction has always been a challenging task due to its dynamic temporal dependencies and complex spatial dependencies. In this paper, we propose a model that combines hybrid Transformer and spatio-temporal…

Machine Learning · Computer Science 2024-01-31 Wang Zhu , Doudou Zhang , Baichao Long , Jianli Xiao

Accurate and timely traffic flow forecasting is crucial for intelligent transportation systems. This paper presents a novel deep learning model, the Spatial-Temporal Unified Graph Attention Network (STGAtt). By leveraging a unified graph…

Machine Learning · Computer Science 2025-08-26 Zhuding Liang , Jianxun Cui , Qingshuang Zeng , Feng Liu , Nenad Filipovic , Tijana Geroski

Traffic prediction is necessary not only for management departments to dispatch vehicles but also for drivers to avoid congested roads. Many traffic forecasting methods based on deep learning have been proposed in recent years, and their…

Machine Learning · Computer Science 2020-05-12 Jichen Wang , Weiguo Zhu , Yongqi Sun , Chunzi Tian

In recent years, traffic flow prediction has played a crucial role in the management of intelligent transportation systems. However, traditional prediction methods are often limited by static spatial modeling, making it difficult to…

Machine Learning · Computer Science 2025-01-09 Mei Wu , Wenchao Weng , Jun Li , Yiqian Lin , Jing Chen , Dewen Seng

Transformers have shown strong ability to model long-term dependencies and are increasingly adopted as world models in model-based reinforcement learning (RL) under partial observability. However, unlike natural language corpora, RL…

Machine Learning · Computer Science 2025-11-11 Daniel De Dios Allegue , Jinke He , Frans A. Oliehoek