English
Related papers

Related papers: SERT: A Transfomer Based Model for Spatio-Temporal…

200 papers

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

Artificial Intelligence · Computer Science 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang

The ubiquity of missing data in urban intelligence systems, attributable to adverse environmental conditions and equipment failures, poses a significant challenge to the efficacy of downstream applications, notably in the realms of traffic…

Machine Learning · Computer Science 2026-05-25 Songyu Ke , Chenyu Wu , Yuxuan Liang , Huiling Qin , Junbo Zhang , Yu Zheng

Spatiotemporal forecasting is critical for real-world applications like traffic management, yet capturing reliable interactions remains challenging under noisy and non-stationary conditions. Existing methods primarily rely on historical…

Machine Learning · Computer Science 2026-05-20 Yinghao Ai , Yukai Zhou , Ruoxi Jiang , Junyi An , Chao Qu , Zhijian Zhou , Shiyu Wang , Fenglei Cao , Zenglin Xu , Furao Shen , Yuan Qi

Spatio-temporal (ST) data, which represent multiple time series data corresponding to different spatial locations, are ubiquitous in real-world dynamic systems, such as air quality readings. Forecasting over ST data is of great importance…

Machine Learning · Computer Science 2018-10-01 Zheyi Pan , Yuxuan Liang , Junbo Zhang , Xiuwen Yi , Yong Yu , Yu Zheng

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

Machine Learning · Computer Science 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Real-world time series data are inherently multivariate, often exhibiting complex inter-channel dependencies. Each channel is typically sampled at its own period and is prone to missing values due to various practical and operational…

Machine Learning · Computer Science 2026-03-11 Jinkwan Jang , Hyungjin Park , Jinmyeong Choi , Taesup Kim

The imputation of missing values represents a significant obstacle for many real-world data analysis pipelines. Here, we focus on time series data and put forward SSSD, an imputation model that relies on two emerging technologies,…

Machine Learning · Computer Science 2023-05-09 Juan Miguel Lopez Alcaraz , Nils Strodthoff

Traffic forecasting has emerged as a crucial research area in the development of smart cities. Although various neural networks with intricate architectures have been developed to address this problem, they still face two key challenges: i)…

Machine Learning · Computer Science 2024-08-27 Jianxiang Zhou , Erdong Liu , Wei Chen , Siru Zhong , Yuxuan Liang

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

Machine Learning · Computer Science 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

Although spatio-temporal graph neural networks have achieved great empirical success in handling multiple correlated time series, they may be impractical in some real-world scenarios due to a lack of sufficient high-quality training data.…

Signal Processing · Electrical Eng. & Systems 2021-02-10 Chao Pan , Siheng Chen , Antonio Ortega

Continuous physical domains are important for scientific investigations of dynamical processes in the atmosphere. However, missing data arising from operational constraints and adverse environmental conditions pose significant challenges to…

Atmospheric and Oceanic Physics · Physics 2025-09-03 Jiahui Hu , Wenjun Dong , Alan Z. Liu

Modern IoT deployments for environmental sensing produce high volume spatiotemporal data to support downstream tasks such as forecasting, typically powered by machine learning models. While existing filtering and strategic deployment…

Machine Learning · Computer Science 2025-12-02 Ragini Gupta , Naman Raina , Bo Chen , Li Chen , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

Machine learning methods for satellite data have a range of societally relevant applications, but labels used to train models can be difficult or impossible to acquire. Self-supervision is a natural solution in settings with limited labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Gabriel Tseng , Ruben Cartuyvels , Ivan Zvonkov , Mirali Purohit , David Rolnick , Hannah Kerner

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

Given a set of synchronous time series, each associated with a sensor-point in space and characterized by inter-series relationships, the problem of spatiotemporal forecasting consists of predicting future observations for each point.…

Machine Learning · Computer Science 2024-06-11 Ivan Marisca , Cesare Alippi , Filippo Maria Bianchi

Effective and Efficient spatio-temporal modeling is essential for action recognition. Existing methods suffer from the trade-off between model performance and model complexity. In this paper, we present a novel Spatio-Temporal Hybrid…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Xu Li , Jingwen Wang , Lin Ma , Kaihao Zhang , Fengzong Lian , Zhanhui Kang , Jinjun Wang

Analyzing and utilizing spatiotemporal big data are essential for studies concerning climate change. However, such data are not fully integrated into climate models owing to limitations in statistical frameworks. Herein, we employ VARENN…

Machine Learning · Statistics 2019-07-24 Takeshi Ise , Yurika Oba

Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ido Faran , Nathan S. Netanyahu , Maxim Shoshany

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang