English
Related papers

Related papers: TSformer: A Non-autoregressive Spatial-temporal Tr…

200 papers

Accurate renewable energy forecasting is essential to reduce dependence on fossil fuels and enabling grid decarbonization. However, current approaches fail to effectively integrate the rich spatial context of weather patterns with their…

Machine Learning · Computer Science 2025-11-20 Federico Battini

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

With the rapid development of the Intelligent Transportation System (ITS), accurate traffic forecasting has emerged as a critical challenge. The key bottleneck lies in capturing the intricate spatio-temporal traffic patterns. In recent…

Machine Learning · Computer Science 2023-10-10 Hangchen Liu , Zheng Dong , Renhe Jiang , Jiewen Deng , Jinliang Deng , Quanjun Chen , Xuan Song

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Mesoscale eddies dominate the spatiotemporal multiscale variability of the ocean, and their impact on the energy cascade of the global ocean cannot be ignored. Eddy-resolving ocean forecasting is providing more reliable protection for…

Atmospheric and Oceanic Physics · Physics 2025-05-16 Qingyu Zheng , Qi Shao , Guijun Han , Wei Li , Hong Li , Xuan Wang

Global Station Weather Forecasting (GSWF) is a key meteorological research area, critical to energy, aviation, and agriculture. Existing time series forecasting methods often ignore or unidirectionally model spatial correlation when…

Machine Learning · Computer Science 2025-09-26 Hongyi Chen , Xiucheng Li , Xinyang Chen , Yun Cheng , Jing Li , Kehai Chen , Liqiang Nie

The leading operational Global Ocean Forecasting Systems (GOFSs) use physics-driven numerical forecasting models that solve the partial differential equations with expensive computation. Recently, specifically in atmosphere weather…

Accurate typhoon track forecasting is crucial for early system warning and disaster response. While Transformer-based models have demonstrated strong performance in modeling the temporal dynamics of dense trajectories of humans and vehicles…

Computation and Language · Computer Science 2025-11-25 Lincan Li , Eren Erman Ozguven , Yue Zhao , Guang Wang , Yiqun Xie , Yushun Dong

An impact of climate change is the increase in frequency and intensity of extreme precipitation events. However, confidently predicting the likelihood of extreme precipitation at seasonal scales remains an outstanding challenge. Here, we…

Machine Learning · Computer Science 2021-07-15 Daniel Salles Civitarese , Daniela Szwarcman , Bianca Zadrozny , Campbell Watson

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

Machine Learning · Computer Science 2026-01-29 Wei Li

Time-series forecasts are essential for planning and decision-making in many domains. Explainability is key to building user trust and meeting transparency requirements. Shapley Additive Explanations (SHAP) is a popular explainable AI…

Machine Learning · Computer Science 2025-12-24 Matthias Hertel , Sebastian Pütz , Ralf Mikut , Veit Hagenmeyer , Benjamin Schäfer

Accurate global medium-range weather forecasting is fundamental to Earth system science. Most existing Transformer-based forecasting models adopt vision-centric architectures that neglect the Earth's spherical geometry and zonal…

This study introduces a cutting-edge regional weather forecasting model based on the SwinTransformer 3D architecture. This model is specifically designed to deliver precise hourly weather predictions ranging from 1 hour to 5 days,…

Machine Learning · Computer Science 2025-03-19 Hongli Liang , Yuanting Zhang , Qingye Meng , Shuangshuang He , Xingyuan Yuan

Extrapolating future weather radar echoes from past observations is a complex task vital for precipitation nowcasting. The spatial morphology and temporal evolution of radar echoes exhibit a certain degree of correlation, yet they also…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Liangyu Xu , Wanxuan Lu , Hongfeng Yu , Fanglong Yao , Xian Sun , Kun Fu

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

The performance of time series forecasting has recently been greatly improved by the introduction of transformers. In this paper, we propose a general multi-scale framework that can be applied to the state-of-the-art transformer-based time…

Machine Learning · Computer Science 2023-02-08 Amin Shabani , Amir Abdi , Lili Meng , Tristan Sylvain

Time-series forecasting plays an important role in many real-world scenarios, such as equipment life cycle forecasting, weather forecasting, and traffic flow forecasting. It can be observed from recent research that a variety of…

Machine Learning · Computer Science 2022-06-14 Benhan Li , Shengdong Du , Tianrui Li , Jie Hu , Zhen Jia

Airport performance prediction with a reasonable look-ahead time is a challenging task and has been attempted by various prior research. Traffic, demand, weather, and traffic management actions are all critical inputs to any prediction…

Machine Learning · Computer Science 2021-11-09 Liya Wang , Alex Tien , Jason Chou

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

The sea surface temperature (SST), a key environmental parameter, is crucial to optimizing production planning, making its accurate prediction a vital research topic. However, the inherent nonlinearity of the marine dynamic system presents…

Machine Learning · Computer Science 2025-04-25 Yin Wang , Chunlin Gong , Xiang Wu , Hanleran Zhang