English
Related papers

Related papers: TSformer: A Non-autoregressive Spatial-temporal Tr…

200 papers

Transformer has emerged as a powerful deep-learning technique for two-dimensional (2D) seismic data interpolation, owing to its global modeling ability. However, its core operation introduces heavy computational burden due to the quadratic…

Geophysics · Physics 2026-01-22 Changxin Wei , Xintong Dong , Xinyang Wang

Spatiotemporal data is ubiquitous, and forecasting it has important applications in many domains. However, its complex cross-component dependencies and non-linear temporal dynamics can be challenging for traditional techniques. Existing…

Machine Learning · Computer Science 2025-03-27 Hao Yuan Bai , Xue Liu

Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior…

Machine Learning · Computer Science 2022-01-10 Haixu Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

Machine Learning · Computer Science 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

A storm is a type of extreme weather. Therefore, forecasting the path of a storm is extremely important for protecting human life and property. However, storm forecasting is very challenging because storm trajectories frequently change. In…

Machine Learning · Computer Science 2025-05-02 Nguyen Van Thanh , Nguyen Dang Huynh , Nguyen Ngoc Tan , Nguyen Thai Minh , Nguyen Nam Hoang

Time series forecasting is a critical and practical problem in many real-world applications, especially for industrial scenarios, where load forecasting underpins the intelligent operation of modern systems like clouds, power grids and…

Machine Learning · Computer Science 2025-06-17 Shaoyuan Huang , Tiancheng Zhang , Zhongtian Zhang , Xiaofei Wang , Lanjun Wang , Xin Wang

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

Machine Learning · Computer Science 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Short-term precipitation forecasting remains challenging due to the difficulty in capturing long-term spatiotemporal dependencies. Current deep learning methods fall short in establishing effective dependencies between conditions and…

Machine Learning · Computer Science 2024-10-18 ChaoRong Li , XuDong Ling , YiLan Xue , Wenjie Luo , LiHong Zhu , FengQing Qin , Yaodong Zhou , Yuanyuan Huang

Computationally expensive and time-consuming Bayesian atmospheric retrievals pose a significant bottleneck for the rapid analysis of high-quality exoplanetary spectra from present and next generation space telescopes, such as JWST and…

Earth and Planetary Astrophysics · Physics 2026-04-30 L. Pagliaro , T. Zingales , G. Piotto , I. Giovannini , G. Mantovan

Deep learning utilizing transformers has recently achieved a lot of success in many vital areas such as natural language processing, computer vision, anomaly detection, and recommendation systems, among many others. Among several merits of…

Machine Learning · Computer Science 2023-12-05 Lena Sasal , Tanujit Chakraborty , Abdenour Hadid

Time Series Forecasting (TSF) is used to predict the target variables at a future time point based on the learning from previous time points. To keep the problem tractable, learning methods use data from a fixed length window in the past as…

Machine Learning · Computer Science 2022-04-26 Jimeng Shi , Mahek Jain , Giri Narasimhan

Weather radar data are critical for nowcasting and an integral component of numerical weather prediction models. While weather radar data provide valuable information at high resolution, their ground-based nature limits their availability,…

Atmospheric and Oceanic Physics · Physics 2024-03-07 Çağlar Küçük , Apostolos Giannakos , Stefan Schneider , Alexander Jann

Reliable weather forecasting is of great importance in science, business, and society. The best performing data-driven models for weather prediction tasks rely on recurrent or convolutional neural networks, where some of which incorporate…

Machine Learning · Computer Science 2022-02-23 Onur Bilgin , Paweł Mąka , Thomas Vergutz , Siamak Mehrkanoon

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Accurate, high-resolution ocean forecasting is crucial for maritime operations and environmental monitoring. While traditional numerical models are capable of producing sub-daily, eddy-resolving forecasts, they are computationally intensive…

Machine Learning · Computer Science 2025-10-27 Qiusheng Huang , Yuan Niu , Xiaohui Zhong , Anboyu Guo , Lei Chen , Dianjun Zhang , Xuefeng Zhang , Hao Li

Accurate, and effective traffic forecasting is vital for smart traffic systems, crucial in urban traffic planning and management. Current Spatio-Temporal Transformer models, despite their prediction capabilities, struggle with balancing…

Machine Learning · Computer Science 2026-01-29 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Xusheng Yao , Junbin Gao

Numerical Weather Prediction (NWP) system is an infrastructure that exerts considerable impacts on modern society.Traditional NWP system, however, resolves it by solving complex partial differential equations with a huge computing cluster,…

Artificial Intelligence · Computer Science 2024-09-26 Junchao Gong , Tao Han , Kang Chen , Lei Bai

Accurate prediction of three-dimensional (3D) wind fields over complex mountainous terrain is essential for renewable energy deployment and regional weather modeling. Traditional computational fluid dynamics (CFD) simulations face two…

Fluid Dynamics · Physics 2026-05-26 Yujia Zhang , Jiaxi Qi , Ruiyan Chen , Yong Liu , Yuzhou Zhang , Lyulin Kuang , Rita Zhang , Shengze Cai

Accurate traffic forecasting is essential for intelligent transportation systems, supporting a wide range of real-world applications. However, it remains challenging due to two key factors:~(1) Traffic series contain heterogeneous temporal…

Artificial Intelligence · Computer Science 2026-05-26 Ruiwen Gu , Qitai Tan , Yahao Liu , Xiao-Ping Zhang

Time series forecasting plays a vital role across scientific, industrial, and environmental domains, especially when dealing with high-dimensional and nonlinear systems. While Transformer-based models have recently achieved state-of-the-art…

Machine Learning · Computer Science 2025-08-05 Ali Forootani , Mohammad Khosravi , Masoud Barati